User-agent: Terrabot Crawl-delay: 5 Disallow: /manager/ Disallow: /2006/ Disallow: /2007/ Disallow: /?cat User-agent: * Disallow: /