User-agent: * Disallow: / Disallow: /d8/ # Crawl-Delay: 20