#; This is the Robots.Txt file that most web sites use, #; See:http://info.webcrawler.com/mak/projects/robots/robots.html User-Agent: * Disallow /cgi-bin # End.