# Robots.txt file # Domain: http://www.18thpurley.org.uk # All robots will spider the domain. # Do not allow them to index the admin area or the members area. User-agent: * Disallow: /admin/ Disallow: /members/