Timeline for Stop bots from crawling old links with extensions
Current License: CC BY-SA 3.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 22, 2019 at 22:07 | comment | added | Joshua | Don't use that Allow. A draft spec had Allow overriding Disallow. | |
| May 6, 2012 at 0:16 | vote | accept | Jared | ||
| Apr 1, 2012 at 1:22 | answer | added | DisgruntledGoat | timeline score: 4 | |
| Mar 31, 2012 at 20:38 | history | tweeted | twitter.com/#!/StackWebmasters/status/186190793365651456 | ||
| Mar 31, 2012 at 18:20 | history | edited | Jared | CC BY-SA 3.0 |
added contents of robots.txt and explanation of solution
|
| Mar 31, 2012 at 18:05 | history | asked | Jared | CC BY-SA 3.0 |