There's something I've been wondering about for a while. Google bots crawlGooglebot crawls a certain number of pages daily, depending on the size of the site. However, what I'm wondering is how long does it take for a particular page. In other words, how many seconds or minutes does it spend on the current scanned page before it goes to the next page it will scan. Is there a set time for this? Or can we think of it as spending 10 seconds while scanning one page and 50 seconds depending on the page's resources? Does it have an average?
Stephen Ostermiller
- 99.4k
- 18
- 141
- 364