# Robot Policy file as per Robot Exclusion standard 17-jun-94 # Match Lycos #User-agent: Lycos #Disallow: /cgi-bin # Match any robot User-agent: * Disallow: /cgi-bin Disallow: /news/?old Disallow: /news/?full