in our serverlogs there are thousands of requests (50-100k) from googlebot every day for urls like /2487763877595434670.htm (as I can see always 19 random digits with .htm at the end)
First the bot requests http:// url that is redirected to https:// version than we block the request with an 404.
Can someone tell me how to find out why googlebot crawls these urls that have never existed? And of course how to stop the bot to waste it´s crawl budget on those useless urls?
I looked for such requests on different domains and only get these requests on our oldest domains (older than 20 years).