18 reputation
14
bio website
location
age
visits member for 2 years, 3 months
seen Nov 17 '13 at 19:07

May
20
comment Need to Stop Bots from Killing my Webserver
Thank you. I'll take a look at this
May
20
comment Need to Stop Bots from Killing my Webserver
Chao, thanks. Currently, I am rewriting my code to convert the file_get_contents to include instead.
May
20
comment Need to Stop Bots from Killing my Webserver
yes I have, thanks
May
18
comment Need to Stop Bots from Killing my Webserver
cool, thanks smassey
May
18
comment Need to Stop Bots from Killing my Webserver
how would I cache the pages? Since the pages are RSS, will the cached pages be refreshed often enough to provide fresh data?
May
18
comment Need to Stop Bots from Killing my Webserver
Actually google bots do read javascript. I did my research on this. How would the validate process work?
May
18
comment Need to Stop Bots from Killing my Webserver
thanks, but I do not want to completely block the Google, MS Bing, and Yahoo bots, but I want to limit there direct hits on the rss2html.php script file. I just need to add something to the beginning of the rss2html.php script that will prevent it from running if it was not accessed via the index.php script. The bots are currently running the rss2html.php script bypassing the index.php file.
May
18
comment Need to Stop Bots from Killing my Webserver
I just need to add something to the beginning of the rss2html.php script that will prevent it from running if it was not accessed via the index.php script. the bots are running the rss2html.php script bypassing the index.php script. I tried this using sessions (see original post above) but it's not working well.
May
18
comment Need to Stop Bots from Killing my Webserver
I did use a cookie login but the site is not really a user login type site. The login was just an attempt to stop the on-slot of bot hits. However, I really want to avoid having a login all together.
May
18
comment Need to Stop Bots from Killing my Webserver
it's an RSS parser
May
18
comment Need to Stop Bots from Killing my Webserver
I tried putting the rss2html.php script code outside of the website in the past and it caused too many loop-back connection that ended up causing excessive CPU resource usage.