Sign up ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I have two sites that should be compliant to googles AJAX Crawling spec ( .

One domain ( was previously indexed, and now lost all search results. Another domain ( never got indexed, and after complying with the spec for a month and a half nothing has changed, and no results show up.

My application contains links in using the #! format, which are made in the following format:!locale/page

a rewrite rule is in place to serve the correct HTML snapshot targeting requests for:

This snapshot is generated by simply dumping the DOM to a nodeJS instance, and wrapping the outputted HTML within new tags.

It becomes obvious at this point that there is no cloaking going on, as i'm simply dumping the DOM for each page, verbatim as a browser with JS enabled sees it.

The reasoning for using an JS app instead of static pages is not part of this discussion.

I'm concerned with the reason, and a possible solution, to why google is no longer indexing the pages. I am pretty sure that i am in full compliance with the spec. I've submitted a sitemap containing all the links as well. Nothing changed. The sitemap is present as "sitemap.txt" for both domains.

If somebody could help shed some light on the issue i'd be very grateful! Thanks!

share|improve this question

1 Answer 1

AFAIK, the and sites do not implement correctly the AJAX crawling scheme from Google you described.

Regarding, it seems escaped fragment URLs always return the same content. For example does not return a snapshot of!en_routes.

Regarding, the rewriting rule does not work sometimes. For example, redirects to which does not exist. It seems also you renamed the "fragments" path to "snapshots". As you can see Google indexed some of these presumed old pages but also tried to get snapshots by using the redirected URL (e.g.!en/news instead of!en/news). It may explain why it did not work.

share|improve this answer
Hi, I'm looking into the rewrite rules on , there seems to be something odd about that, indeed. – DLeonardi Jan 13 '13 at 22:41
Regarding , i did rename fragments to snapshots, because google had indexed the files submitted via sitemap but i had forgotten the <meta name="fragment" content="!"> meta tag. i added that, and since the google index was corrupted [it was indexing wrong links which broke the app] i made the folder name change and adjusted the rewrite rules accordingly. – DLeonardi Jan 13 '13 at 22:42
I also received a hint from another user that i might not be respecting the spec 100% because the spec says "#!key=value" and i, essentially, only have "#!value" – DLeonardi Jan 13 '13 at 22:43
You are not forced to use key=value format. See this doc:…. – check_ca Jan 13 '13 at 23:58

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.