1 2 3 4 5 6 7
User-agent: * Crawl-delay: 120 Disallow: /.git/ Disallow: /drafts/ Disallow: /includes/ Disallow: /rss.xml Disallow: /templates/