0

I am having a headache understanding how and when google indexes a page . I watched this guy's video a bit , and in one of the videos, he says "google indexes a page every 2 days" but if it notices the updates on your website are slow, it might take a month. Also in the case of unindexed pages it might take longer .

Now I have updated the title of my website and also the meta tags, but when google had crawled my site links initially, the title and meta tags were not there. I searched google for my site again and it doesn't show the new and updated title nor the descriptive description. I know google chooses this sometimes, but I have carefully worded my statement for it to show up.

So now I want my site to be re-crawled, and after googling and googling I found only one helpful link here :

It has the following pointers:

Your fetch must have a complete, partial, or redirected fetch status.
Your fetch must use the Desktop or Mobile Smartphone Googlebot type.
Your fetch cannot be more than 4 hours old.

I understand neither of the above. I guess the 2nd point has either something to do with the desktop/mobile drop-down in the dashboard or the robots.txt file.

Can somebody explain these pointers please . its all over my head .

PS. I can see the following dashboard so far :

enter image description here

Thank you.

1

When Google crawl the web they use a variety of standard automatic custom "web browsers" that they call "bots" (short for "robot"). These bots may not see your web-page in exactly the same way as you do when you use a web browser like Firefox or Chrome. "Fetch as Google" is a way to see how your pages look to the Google bots. Think of it as viewing the web though Google's eyes.

Google prefer to crawl pages on their own schedule.

If you want to signal to them that your content has changed and needs to be re-crawled you can use the "Submit to Index" tool.

Please note that I am assuming your question implies that you specifically wish to use the "Submit to Index" tool (which forces you to use the "Fetch as Google" tool). Please be aware that the "Submit to Index" tool is not the only way to achieve the goal of getting your site re-crawled and re-indexed. Industry best practice on how to do this is a much broader question.

The "Submit to Index" button will not appear until you do a "Fetch as Google" and fulfill their list of criterion. This is to force webmasters to check for and fix most of the common problems that cause crawling & indexing problems for the Google-bots. "Fetch as Google" is not instant and can take a few seconds to a few minutes. Note that using the "Submit to Index" tool is JUST a signal to them. There are no promises about how long before they will actually do it.

What the criterion mean ...

Your fetch must have a complete, partial, or redirected fetch status.

This just means that the result they display is the "status" column when the fetch is done must be one of those words "complete" or "partial" or "redirected". If you get something else it's probably an error you need to take care of.

Your fetch must use the Desktop or Mobile Smartphone Googlebot type.

There are 4 options on the drop down list

  • Desktop
  • Mobile: Smartphone
  • Mobile: XHTML/WML
  • Mobile: cHTML

You must only use the first 2 with the "Submit to Index" tool.

Your fetch cannot be more than 4 hours old.

The steps are as follows ...

  1. YOU click the "Fetch" button
  2. YOU wait a few seconds (usually) for GOOGLE to do the fetch
  3. When done, GOOGLE displays the "Submit to Index" button
  4. GOOGLE waits for you to press the "Submit to Index" button
  5. GOOGLE adds your "Submit to Index" request to the database.

Basically Google are just saying that step 4 cannot be longer than 4 hours. I would presume that most people press the "Submit to Index" button immediately but perhaps if step 2 takes a few minutes they might get bored and wander off for a cup of coffee and forget about it for hours and then click it and discover it doesn't work or cause some minor annoyance to the Googlebot.

  • With respect, it is very very bad advice to recommend using Fetch as Google as routine. Abuse of this feature will assure that it disappears. Trying to hurry Google up is not a good idea. Google gets mad. Google uses a TTL style metric that adjusts based upon a pages freshness. The proper advice is to make sure that content is added and updated regularly according to what is natural. I only recommend using the Fetch as Google to correct critical errors in small doses. Other than that, just let any search engine do what it does best- especially Google since it is fairly responsive already. – closetnoc May 28 '15 at 21:32
  • closetnoc, you may well have a point but I didn't and don't give any advise, implied or explicit, on how suitable "fetch" is for any purpose. I limited my answer specifically to address the question which was asking to explain the 3 "pointers" not the much broader question of industry best-practice to routinely keep content indexes up to date. Perhaps the question need to be edited for clarity ? – John McNamara May 28 '15 at 23:45
  • Again, with respect, when I read this answer, the take-away (to me anyway) is that the Fetch as Google is the solution you are recommending. Fair credit: I do like the answer: the detail, the explanation, etc. – closetnoc May 28 '15 at 23:49
  • closetnoc, thanks for your input. as miscommunication seems genuinely possible I have added some clarification as regards the context of industry best practice. If anyone can leave a link to a good question/community wiki covering that topic I will add it in. – John McNamara May 29 '15 at 0:26
  • FYI google.com/webmasters/tools/mobile-friendly is being heavily prompted and effectively contains a "Fetch and Render as Google" tool. I would presume they are happy to get very heavy traffic on this tool for the foreseeable future ? – John McNamara May 29 '15 at 0:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.