I was submitting my sitemap in Google Webmasters and got this message when I clicked on the "test sitemap" button:
-Warning - URL blocked by robots.txt.
When I located my robots.txt
file, this is what I saw in the robots.txt
file:
# BEGIN GENESIS SEO
User-Agent: *
Disallow: /category
Disallow: /tag
Disallow: /author
Disallow: /?s=*
# END GENESIS SEO
Does anyone know what is the implication of this and how I should fix it please?
robots.txt
file, it looks like you could perhaps just ignore this warning, or remove the entries from your "sitemap"? – DocRoot May 20 '18 at 17:55robots.txt
entries you have shared prevent the same pages being indexed by multiple URL's which can be (didn't say is) bad for SEO if you do not have proper canonical references for all content. – Willtech May 21 '18 at 12:34