2
votes
2answers
30 views

For performance reasons: have different pages for search engines and users

I have a SEO question for single page applications. We're working on a SPA (not yet public) that displays tables of numeric data to users. The data volume is large, number aggregations are costly ...
2
votes
3answers
153 views

How to decrease the frequency of Google/Search-engine bots crawling my site?

My server handles my visitors ok, but recently I found there are many search engine bots crawling my site and my server gets quite busy serving these bots. My site generates over 1000 posts each day, ...
2
votes
4answers
673 views

Google bots are severely affecting site performance

I have an aggregate site on a linux server that pulls in feeds from a universe of about 2,000 blogs. It's in Wordpress 3.4.2 and I have a cron job that is staggered to run five times an hour on ...
1
vote
1answer
162 views

Do or can robots cause considerable performance issues?

At work we are in a discussion with team members who seem to think bots will cause us problems relating to performance when running on our services website. Our setup: Lets say I have site ...