Google recently cut my indexed pages in half, which cuts revenue in half, which is pretty concerning.
I have a large database driven website (millions of pages) which dynamically creates content with PHP based on MySQL content for that item. I was hoping to improve the user experience, ranking, and number of indexed pages.
So I created a large amount of unique written content for product categories and sub-categories, which includes images, charts, etc. This is printed at the bottom of each product's page that is in that category. The products name is inserted into the paragraph, so it's slightly unique but still, obvious template content.
It seems... as a result Google, about cut my indexed pages in half and moved them into the "Crawled - currently not indexed" category".
This is obviously surprising and frustrating to be penalized for the a lot of hard work, which I believed would benefit the user. There wasn't any other structuring changes made around this time. So unless it's random, it appears Google doesn't like this template content.
There are a few reasons listed for the pages being doomed to "Crawled - currently not indexed" status, the only one I can see that fits, is the "thin content" complaint. Now, of course, the pages don't have any less unique content. But it dawned on me that Google could be looking at the page content as a ratio/percent of unique content.
As the total content increases, the percent of unique content per page decreases. Perhaps this has soured the algorithmic view on my pages?
If these pages were made of complete duplicate content, I could see the problem, but does simply adding duplicate content from my own site create a problem?
I couldn't find any documentation on webmaster tools or good advice from SEO guru sites.
I would hate to go back and remove all the content since I think it adds real value to the user and took a lot of work.
So I'm not sure what to do...
If anyone has experience, research, or back-testing on an issue like this, I would deeply appreciate it. Thank you!