1

I have been reviewing 404 error logs on a WooCommerce site I have been working on (logs held within the website server) and there are a lot of requests to product pages which have /false on the end of the url. For example,

  • Requested https://www.example.com/product/stretchy-bracelet-crackled-quartz/false
  • Valid URL https://www.example.com/product/stretchy-bracelet-crackled-quartz/.

There are no links within the site which link to these .../false addresses, yet some of the requests seem to be from GoogleBot according to whois searches on the requester's ip addresses such as https://www.google.com/search?q=whois+66.249.75.45.

There is no referer information in the logs and the website has just been put on Google Search Console. I am now waiting for the console to finish processing its data which may take a while as there are a lot of products pages it will be looking at whilst crawling.

Can anyone shed any light on a possible cause for this phenomenon?

  • Can you find the URLs in the Google Search Console 404 error report? If so, Google often says where it found the URL. – Stephen Ostermiller Oct 3 at 14:37
  • Do any of the requests send a referer header? Googlebot won't but maybe some other user agent is giving you a clue. – Stephen Ostermiller Oct 3 at 14:38
  • @StephenOstermiller - There is no referer information and the website is not on Google Search Console as of yet. Going to put the site on there to see what it comes up with – Chris Rogers Oct 3 at 14:50
  • That could take a few weeks until Google starts giving you useful information. – Stephen Ostermiller Oct 3 at 15:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.