On my site is a page that hosts all my ad entries. Each URL and its content is different. Google was indexing all the different URLs until entry 4570. As I can see in GWT Google Index they also stopped crawling the new entries (70,000) at this moment.
I would like to understand why Google stopped. I added a sitemap at about this time. The sitemap generator doesn't produce the single ad URLs.
I had to change a page name and put a redirect in my .htaccess file:
Redirect permanent /aerzte/ http://www.example.de/arzt/
Google stopped about one week later to add new URLs. Can one of above be the reason?
Is there a different solution - without sitemap - to get Google to index these URLs?
P.S.: I can add URLs with Google Fetch and these URLs are immediately indexed.