All Questions
3 questions
2
votes
1
answer
69
views
Do search engines crawl links with query strings?
If I were to have a url like https://example.com/books, that contained several links to urls such as:
https://example.com/books?id=foo
https://example.com/books?id=bar
https://example.com/books?id=...
- 227
1
vote
0
answers
42
views
How does a webmaster perform a proper redirect from one domain to another? [closed]
There are a few questions that are inherently present inside the main question. Those questions are:
What is the best way to perform this type of redirect? (Presumably a 301 Perma for SEO Best ...
- 55
5
votes
5
answers
4k
views
Should I block agent Wget/1.12 (linux-gnu)?
Is that a scraper? It tried accessing my site which is currently password protected for testing purposes. shall I block it?
- 133