Tag Info

New answers tagged


Good catch! If you're blocking a page with robots.txt then crawlers will not able able to read the noindex meta tag. In these cases you should send the x-robots-tag HTTP header either via server-side code or .htaccess. .htaccess example: X-Robots-Tag: noindex Sample PHP code: header('X-Robots-Tag: noindex');

Top 50 recent answers are included