User-agent: Googlebot Crawl-delay: 5 User-agent: MediaPartners-Google Crawl-delay: 5 User-agent: ScanAlert Crawl-delay: 20 User-agent: MSNBot Crawl-delay: 20 User-agent: Slurp Crawl-delay: 20 User-agent: Scooter Crawl-delay: 20 User-agent: Lycos Crawl-delay: 20 User-agent: Gigabot Crawl-delay: 120 User-agent: Yandex Crawl-delay: 120 User-agent: StackRambler Crawl-delay: 120 User-agent: Teoma Crawl-delay: 120 User-agent: ia_archiver Crawl-delay: 120 Disallow: /_includes/ Disallow: /_templates/ Disallow: /files/ Disallow: /wp-admin/ Disallow: /blog/wp-admin/ Disallow: /wp-includes/ Disallow: /blog/wp-includes/ Disallow: /wp-content/ Disallow: /blog/wp-content/ User-agent: * Disallow: /*?n=*