New answers tagged wordpress
1
Don't use crawl directives for cross-purposes.
Crawl and index instructions are very literal. I see it all the time where people try to use one type to get another type's effect, when they really need that type. For instance what you want is pages removed from the index, but what you're saying is "don't crawl my pages".
Those things are not the ...
3
I believe you have physically removed the wp-includes folder so that server returns 404 for the concerned URLs. If yes, you should not block the URLs in robots. Else Google will not try crawling those URLs. Only if Google tries to crawl, it will know if the URLs have been removed. Only then it will start removing them from the index.
Top 50 recent answers are included
