# robots.txt for www.croquet.org.uk # This file restricts webCrawlers (e.g. Google, Altavista...) from certain parts of the site # The first line is a required header for some sites. # Text following a hash on any line represents a comment User-agent: * # All Crawlers Disallow: /history/archives/2001/ Disallow: /history/archives/2002/ Disallow: /history/archives/2003/ Disallow: /history/archives/2004/ Disallow: /history/archives/2005/ Disallow: /history/archives/2006/ Disallow: /history/archives/2007/ Disallow: /history/archives/2008/ Disallow: /private/ #Disallow: /scripts/ Disallow: /dbase/ Disallow: /secf/ Disallow: /cert2005-2006/ Disallow: /cert/ Disallow: /_notes/ Disallow: /pages/ Disallow: /temp/ Disallow: /aspnet_client/ Disallow: /infra/cache/ Disallow: /infra/docs/ Disallow: /infra/gazette/ Disallow: /W3SVC181/ Disallow: /SQLBackups/ # Lines added 2024-08-24 to prevent the server being overloaded Disallow: /*games/clubs/details Disallow: /*tournament/caCalendar Disallow: /*tournament/caEvents