Timeline for When you move a site via a 301 redirect should you setup a robots.txt disallowing robots to crawl the old address?
Current License: CC BY-SA 3.0
3 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jul 5, 2017 at 11:45 | comment | added | Theo van der Zee | Yes, that is exactly what would happen if the robots.txt is blocking access to the bots. | |
| Jul 5, 2017 at 11:19 | comment | added | mat boy | Would it also mean that link juice that was pointing to the old domain won't be transferred to the new domain because the robots.txt is not letting Gbot crawl? | |
| Jul 5, 2017 at 10:48 | history | answered | Theo van der Zee | CC BY-SA 3.0 |