I am trying to analyse the .htaccess file of a website, specifically the following piece of code:
<FilesMatch ".pdf$"> <IfModule mod_headers.c> Header set X-Robots-Tag "noindex, noarchive, nosnippet" </IfModule> </FilesMatch>
It is supposed to noindex all the PDF files of the website.
However, the PDF files are still there up and running, and I am sure about it because:
- they still appear in SERPs
- they are green in search console
- the header check does not show any command about noindexing
How is that possible? My hypothesis is that there is some conflict in the .htaccess code.
User-agent: * Allow: /wp-admin/admin-ajax.php Disallow: /web_service/ Disallow: /wp-admin/ Disallow: /xmlrpc.php Sitemap: https://www.example.com/sitemap.xml