# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://www.autogumibolt.hu # All robots will spider the domain User-agent: * Disallow: User-agent: bingbot Crawl-delay: 2 User-agent: Slurp Crawl-delay: 2 # Disallow directory /docs/ User-agent: * Disallow: /docs/ Disallow: /fpdf/ Disallow: /stat/ Disallow: /includes/ Disallow: /modules/ Disallow: /ebolt/idopont* Disallow: /[0-9]\d*-details