# /robots.txt for to stop reading of non-public pages User-agent: * Disallow: /cgi-resources Disallow: /cgi-bin