##################################################################### # payablesystems.com robots.txt file updated 2008-04-08 # ##################################################################### # # Read the robots exclusion standard at # http://www.robotstxt.org/wc/norobots.html and understand your # own file structure before you exclude robots or you could # accidentally prevent your site from being spidered # correctly or you could even prevent it from being spidered at all! # Some spiders are ill-behaved and will ignore this file! # This file created by Michael Hess @ webkandy.net ##################################################################### # Extended standards - these may or may not be used by some spiders # ##################################################################### # Adjust the crawl rate for some engines - Do this in Google from # the Dashboard. Yahoo, MSN and Ask use this standard. Googlebot # ignores this rule Crawl-delay: 10 # For all other robot spiders in general User-Agent: * # Where is the sitemap.xml Sitemap: http://payablesystems.com/sitemap.xml # Disallow indexing specific files Disallow: /google9d84e9eef9a8c97c.html Disallow: /googlea6abf639c33b8168.html Disallow: /formmail.asp Disallow: /partners_bak.asp Disallow: /formmail.asp # use trailing slash to exclude files # below a specified directory Disallow: /cgi_bin/ Disallow: /_private/ Disallow: /vti_cnf/ Disallow: /vti_log/ Disallow: /images/