Timeline for robots.txt being ignored - wordpress install
Current License: CC BY-SA 3.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| May 9, 2015 at 15:39 | comment | added | Mike -- No longer here | Is there a possibility that a different robots configuration is displayed based on country? Run robots.txt through webpagetest.org on multiple systems in different countries and see what happens. If its inconsistent, then maybe someone is messing up your account. | |
| May 8, 2015 at 19:02 | history | edited | MrWhite | CC BY-SA 3.0 |
Removed syntax highlighting and "thanks"
|
| May 8, 2015 at 13:15 | comment | added | zigojacko | I ran the same check as @w3d in Google as well and couldn't see an issue with indexation either. | |
| May 8, 2015 at 9:35 | comment | added | MrWhite | For which URL do you get the "A description for this result is not available because of this site's robots.txt" message in SERPs? That site does appear to be indexed OK by Google ("197 results") from what I can see and all results show a valid description - which does not correlate with the "blocking" robots.txt you are reporting? | |
| May 8, 2015 at 7:24 | answer | added | zigojacko | timeline score: 2 | |
| May 8, 2015 at 5:59 | review | First posts | |||
| May 8, 2015 at 7:17 | |||||
| May 8, 2015 at 5:56 | history | asked | Chris J. Popp | CC BY-SA 3.0 |