All Questions
1 question
2
votes
1
answer
306
views
If a web crawler get a 404 error, will it not index that url?
Say I have a page page.example.com/page. In my (python) server, you only get served html if you are logged in, which you can do at page.example.com/login. If you aren't logged in, the server responds ...