504 reputation
412
bio website brendonboshell.co.uk
location London, UK
age 22
visits member for 3 years, 4 months
seen Oct 19 at 13:42

Jul
29
comment A one-day loss statistics from Google
You seem to be operating a scraper site; I suspect you've been penalised.
Apr
19
comment Referrals from googleads.g.doubleclick.net . I don't have adwords running
Do you have any other ad agreements running outside of AdWords? A lot of publishers use the DoubleClick platform to track serve and track advertising -- as far as I am aware, the referral source is the same as for AdWords.
Jan
29
answered Nesting Schema itemtypes: Article and Person
Jan
12
comment Our Website is being blocked in critical areas - how do I get to the bottom of this?
A traceroute will tell you where problems are occurring.
Dec
28
awarded  Enthusiast
Dec
17
comment Search engines that index your site despite a disallow in robots.txt
All this does is change your robots.txt file, which instructs search engines which pages they can crawl, and which they cannot. Whether or not they obey those instructions is up the bot.
Dec
12
comment Bot crawling my site, blocked it, now it's back and can't stop it
Bots don't show up in Google Analytics. Are you sure they are bots?
Dec
8
awarded  Yearling
Dec
8
answered What is the strategy for Google AdSense to open ads link?
Dec
8
comment How to handle browser-compatibility check for your website
There are some web services like Browser Stack for you pay a monthly fee and can test on lots of web browsers over lots of operating systems. It's a lot simpler than managing your own virtual machines.
Dec
6
comment Displaying pages that rely on iframes in crawler friendly way
I don't have an answer for your question, but I just wanted to mention pjscape as it might help with your scraping. It uses jQuery so you should be able to pick out the specific parts of the HTML that you want, and then discard everything else. This would be an easier way of pulling out tables, lists, etc.
Dec
4
comment In WordPress, should I “Allow search engines to index this site” during development?
Ideally, you wouldn't have a development site on the live web. But that aside, I'd probably leave the option on -- you won't get much traffic until the website has content anyway.
Dec
3
comment Cloud hosting pay per hour, but Google robot crawls almost 24/7
The point of cloud hosting is you pay for every minute the server is running, not per request. So you might need to scale to 3 servers during a busy period. But you need to have at least 1 server running continuously to host a website.
Dec
3
comment Cloud hosting pay per hour, but Google robot crawls almost 24/7
You pay per hour that your server is running, no per hour the website is being visited.
Dec
3
comment Is it necessary to specify content-type in http response header?
I believe you need to specify Content-Type for scripts to execute in IE. This is to prevent malicious users uploading scripts to image sharing websites.
Dec
2
comment Remove incorrect date from Google snippet
Are you sure you haven't got your dates muddled, because this page appears on 16 July, 2005 in Archive.org's Way Back Machine.
Dec
2
comment Website won't work without www on mobile phone
You seem to have deleted the DNS records for your non-www name as they don't resolve on my machine. I can't access the website without www, and I'm on a desktop.
Nov
29
answered How should “AdSense and DoubleClick” phrase in Google Webmaster Guidelines be interpreted?
Nov
25
comment Why would someone try viewing the site with unsupported languages?
It could be that your visitors don't speak English as a first language. Or it could be a clever bot/cache-server trying to detect whether you serve UA-dependent content.
Nov
25
answered How to track site searches in Google Analytics?