Google’s Gary Illyes shares an unconventional but valid method for centralizing robots.txt rules on CDNs.

  • Robots.txt files can be centralized on CDNs, not just root domains.
  • Websites can redirect robots.txt from main domain to CDN.
  • This unorthodox approach complies with updated standards.



Source link

Avatar photo

By Rose Milev

I always want to learn something new. SEO is my passion.

Leave a Reply

Your email address will not be published. Required fields are marked *