# $Id: robots.txt,v 1.00 2006/08/02 00:00:00 maid-a@maid-san.org.uk $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Comments to the webmaster should be posted at # # Format is: # User-agent: # Disallow: | User-agent: baiduspider Disallow: / User-agent: psbot Disallow: / User-agent: SBIder Disallow: /