inhales While X-Robots-Tag and meta robots are equivalent, robots.txt is different. The former is about indexing, while the latter is about crawling/visiting. Tell bots not to visit a URL by using robots.txt. Use only one of the three for each URL. Using both X-Robots-Tag and meta robots on a URL is redundant because they are equivalent, and using both ...


So i found a workaround for this - i had to add the disable-performance page rule to cloudflare. Now i seem to be correctly getting a HTTP 304 in the browser.

Only top voted, non community-wiki answers of a minimum length are eligible