# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # User-agent: * Disallow: /item.php?pid Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /account/ Disallow: /cgi-bin/ Disallow: /chat2/ Disallow: /css/ Disallow: /developers/ Disallow: /download/ Disallow: /hot/ Disallow: /inc/ Disallow: /libs/ Disallow: /logs/ Disallow: /new/ Disallow: /news/ Disallow: /order/ Disallow: /session_clear/ Disallow: /test/ Disallow: /work/ Disallow: /software/item.php? Disallow: /software/?ss