1

I have some "static files" that I build on the fly, because they are generated dynamically.

ads.txt
robots.txt
sitemap.xml

What is the ideal Cache-Control for those files? PS: My server is behind a CDN.

Can I leave them as private or should I go with no-store?

I guess the result would be the same, because neither will be cached by the CDN and private enforces validation any way.

1
  • 1
    I'm not sure that it matters. Google only fetches robots.txt once per day no matter what your cache control headers are set to. Feb 17 at 15:50
4

I understand you want to use Cache-Control private/no-store because you don't want the CDN to cache an outdated version of those files. However, not caching these files (i.e. all requests go back to your origin) might make your server vulnerable to a DDOS attack.

Leverage the CDN for what it does best. Unless these files change several times in the hour, I suggest caching them for at least a minute if not more.

Cheers.

1
  • That's a good point. I haven't thought of it like that. Thank you. Feb 18 at 8:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.