253 reputation
28
bio website
location Bristol, United Kingdom
age
visits member for 4 years, 1 month
seen Feb 25 at 10:21

Oct
25
comment Google lists redirected URL instead of target URL
Checked again and the old URL has been replaced by the new one. Success :¬)
Oct
10
comment Google lists redirected URL instead of target URL
Tried Disallow: /*/* to just disallow subdirectories, with a .htaccess 301 redirect on the root and old homepage. This has got rid of the 'robots.txt' message but Google is still displaying the old URL. Will wait a few days and see if it updates.
Oct
7
comment Google lists redirected URL instead of target URL
That makes sense. We need to have the old site in robots.txt though as it was messing up the search results. So I guess we need robots.txt to disallow the site but allow the root page?
Jun
20
comment What's the proper way to handle Allow and Disallow in robots.txt?
Aha! According to Wikipedia, Google just looks at the number of characters to determine which directive to use and in the case of a 'draw' goes with 'Allow'.
Jun
20
comment What's the proper way to handle Allow and Disallow in robots.txt?
The order of Allow and Disallow statements makes no difference for Googlebot which looks at specificity instead. Bing also but don't know about other search engines so if in doubt put Allows first I guess.
Jun
20
comment What's the proper way to handle Allow and Disallow in robots.txt?
The above is how Googlebot handles your examples as can be tested on their robots.txt testing tool (Webmaster Tools > Blocked URLs). Google doesn't mind whether you put the Allows or Disallows first but has an algorithm that determines specificity, which leads to some not obvious results. For example, if you replace '/*.html$' with '/*myfile.html$' in the 3rd example, then 'myfile.html' is allowed rather than being blocked OR if you lose the trailing '/' from '/norobots/', .html files are also allowed.
Feb
2
comment How can I simulate a slow connection for page load?
Or try running the connection via the Tor Project proxies..
Jul
31
comment Are there any downsides of including google-analytics on your website?
@Jamie. Interesting. Hadn't spotted that.
Jul
15
comment How can I simulate a slow connection for page load?
How about running BitTorrent at the same time :¬)
Jul
13
comment Are there any downsides of including google-analytics on your website?
It is if you can get access to users ISP logs and account details to tie an IP address to a particular account. Your web server will be recording IP addresses in it's logs already.
Jul
12
comment How do you format SEM URLS to properly track results using analytics engines like Google analytics?
Do you mean 'utm_' rather than 'stm_'?
Jul
12
comment Is there any benefit of Google Analytics asynchronous tracking code if it isn't placed in the <head>?
Google imply that you can put the code pretty much anywhere but that for most pages the optimal place is at the bottom of the <head> (code.google.com/apis/analytics/docs/tracking/asyncTracking.html)
Jul
11
comment How do I test the usability of my website?
Steve Krug took out all the user testing stuff from 'Don't MMT' for the 2nd edition and expanded it into 'Rocket Surgery'. The missing chapters from the 1st edition can be downloaded for free from his site (sensible.com/dmmt.html)
Jul
11
comment Are there any downsides of including google-analytics on your website?
GA won't slow the loading/display of your page if the code is put in the bottom of the page (or if you use the new asynchronous tracking code).
Jul
11
comment Are there any downsides of including google-analytics on your website?
GA only records the time when the page is loaded by the browser - it doesn't run any code as you leave a page. The time on page is just the difference in time stamps between one page an the next.
Jul
9
comment Good tool to crawl my site and help me find dead link and unlinked files
Check the 'Orphan files' option in the options and it will prompt you for an ftp login to your site.
Jul
9
comment Should I combine js/css files into a single file?
Though you do need to be very aware of the initial impression given by your home page / landing pages. If the first page a visitor sees is slow to load they might not bother to look at a second page.
Jul
9
comment Way to list “Contact Us” email address on web site, yet reduce likelihood of spam?
Nice idea - and accessible too
Jul
9
comment Way to list “Contact Us” email address on web site, yet reduce likelihood of spam?
How do you know your users know to remove 'no-spam'? You're only going to hear from the ones who do :¬)