# Stop ms from generating 404 errors User-agent: msnbot Disallow: /familytrees/album_lotr/ # LinkWalker knows where to go. User-agent: LinkWalker Disallow: / # Archive.org was hammering site - Foff User-agent: archive.org_bot Disallow: / User Agent: * Disallow: /images/ Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /familytrees/admin/ Disallow: /nzart/ Disallow: /assets/