I don't understand how this didn't make a bigger BOOM online.

It is well known in the industry that google does not index AJAX (just google-search "google crawls ajax") and see dozens of articles stating that google does not crawl ajax by default.

There's a whole Google AJAX Crawling Guidelines thing going on, if you want to help google crawl your AJAX based content (by creating mirror pages for the search engine).

But 4 days ago, this technique had been deprecated.

Now, in their blog post about it Google explains that

Back then, our systems were not able to render and understand pages that use JavaScript to present content to users. [...] Times have changed. Today, as long as you're not blocking Googlebot from crawling your JavaScript or CSS files, we are generally able to render and understand your web pages like modern browsers.


This is BIG and I don't see it getting attention online.

This is also a big f**k-up for me personally.

A couple of years ago I started using AJAX for loading user comments on my website, knowing that google does not crawl ajax.

Now I looked at a couple of my website's pages that are seemingly banned, or over-looked by Google.

And to my surprise, lots of these exact pages contain bad quality content (keyword stuffing etc.) within the comments.

How can one know if his AJAX based content is being crawled?

Using the "Fetch as Google" tool will NOT show the AJAX based content. Also, google-searching for exact phrases that appear in the AJAX based content does not return results.

The whole subject is very confusing.

  • Not exactly sure what your question is here, anyway. One second your talking about google and ajax and then you talk about your site having bad content. There's no real question here.
    – John Conde
    Oct 18, 2015 at 17:11
  • No, the bad content is withing the ajax based content. Which according to everyone - is not supposed to be crawled by Google!
    – Django
    Oct 18, 2015 at 17:12
  • This is NOT a duplicate of a question from 2010. Times have changed. This is the whole point. @JohnConde
    – Django
    Oct 18, 2015 at 17:13
  • Made my question clearer. @JohnConde
    – Django
    Oct 18, 2015 at 17:20
  • Times have changed ~ answers can be improved and new answers can be added, there's never any need to create a new question. Questions can gain attraction through quality improvements via editing, and users can run bounty's to gain even better answers, more up to date and so on. Oct 18, 2015 at 17:32