#Default robots.txt file (which asks all bots to crawl slowly but still index everything). User-agent: * Crawl-delay: 1 Disallow: /?* Disallow: /wp-admin/ Disallow: /*?fb_comment_id Sitemap: https://www.enlaces.cl/sitemap_index.xml