3,642 reputation
1926
bio website is.linkedin.com/pub/…
location Iceland
age 37
visits member for 4 years
seen 18 hours ago

Software developer / Project manager working for the National Library of Iceland.


Jan
7
comment Is there a way to make Alexa's ia_archiver slow down its crawling of my website?
Why haven't you tested the Crawl-delay directive? It's dead simple to implement and Alexa is a responsible company and known to honor robots.txt. I'd be astonished if they didn't honor the crawl-delay directive.
Aug
17
comment Repeated calls with random Javascript append to the URL
@Christopher It is good etiquette, if your a crawl operator, to design your user-agent in a manner that allows site admins to contact you if there is a problem. Typically, this takes the form of "Mozilla/5.0 (compatible; CRAWLERNAME/VERSION +OPERATOR_CONTACT_URL)", e.g. Mozilla/5.0 (compatible; heritrix/3.1 +example.com). This gets around most of the browser sniffing while still being polite to the site admins. I speak from experience having operated web crawlers for the last 8 years. Also, this is staight out of the Internet Archive's playbook. One of the biggest crawlers around.
Aug
14
comment Tracking different types of users
I don't want to entirely exclude internal traffic (as this would seem to do). I simply want to be able to separate internal and external traffic as they behave differently.
Jan
9
comment Stop searches showing tld domain sites appearing as subdirectory of main holding site domain?
@therobyouknow How long it takes depends on how often Google crawls your site. Could be a few days, could be a few weeks. No good way to tell.
Oct
12
comment Is it wise to use a country-based tld when a .com already exists, but is “Under Construction”?
It is a matter of perception. ccTLDs tend to be perceived as relating to that country whereas .com speaks to a global audience (.net also works to a lesser extent). There is also less likely to be confusion between your site and the .com if you are targeting a narrower audience.
Sep
5
comment What is the best way to show your users that they use an incompatible browser?
Possible duplicate: webmasters.stackexchange.com/questions/651/…
Sep
2
comment Tactics for dealing with misbehaving robots
That is a very interesting idea, although in case they are using a very generic user-agent, you wouldn't want to blanket lockout any user-agent automatically.
Aug
30
comment two domain names, one hosting
@Mahesh, no, del.iciu.us and delicious.com both redirect to www.delicius.com
Aug
29
comment Should I remove subdomains?
Google wouldn't care if they are 301s. What Google tends to frown on is serving up the same content on both subdomain.example.com and example.com. Or, for that matter, on two unrelated domains.
Aug
18
comment Adding text shadow to your whole website
There doesn't seem to be a question in there
Aug
18
comment Understanding Google Crawl Stats
Your server logs should tell you what pages Google is crawling. As for the HTTP headers, there are a number of Firefox plugins. Personally I use Firebug.
Jul
28
comment Are there any technical issues with having an 'internationalized' domain name?
We always buy both forms. In fact the .is registrar significantly discounts the IDN form in these instances so it isn't much of an issue.
Jul
18
comment The Necessity of a Disclaimer
You are asking for legal advice. This will likely vary depending on where you live. You should consult a lawyer! That said, there can not be any harm in having a disclaimer.
Mar
14
comment Laws on credit card information?
Legalities aside, unless you're big enough that your name carries some weight (e.g. Amazon, Apple etc.) I (as a customer) would feel much more comfortable giving you my CC number if you promised not to store it!
Jan
14
comment Detecting Browser Types?
@Mike My point was that Chrome (being Webkit under the hood like Safari) will almost certainly work just as well. And Opera should also work on a site that works in the three browsers mentioned. While it is common for clients to specify something like this, it is up to guys like us to educate our clients. At most the users of recent versions of Chrome and Opera should get a warning that their browsers are not supported. Excluding them is bad form.
Jan
14
comment Detecting Browser Types?
Based on your list of accepted browser, it seems really strange to exclude Chrome and I'd be very surprised if the latest version of Opera can not handle something that the above browsers can.
Jan
5
comment Getting SSL certificate for a sub-domain
Why not get a wildcard SSL cert for mycompany.com so that you can set up SSL on it and any of its subdomains?
Dec
3
comment How can I clone or mirror a site without SEO penalties for duplicate content?
@Amanda You can be confident that any robot from a respectable search engine will honor robots.txt. It is in their best interest to do so. And if they never crawl something - because its disallowed by robots.txt - they do not know it exists.
Dec
1
comment Publishing A Graphic Novel Online?
DjVu is a dying format. We used to use it for digital reproductions of printed material (exactly what DjVu was designed for), but had no end of complains from users that had trouble installing the plugins etc. Especially if the user wasn't using a standard Windows+IE6 combo. The situation has only gotten worse with time.
Nov
18
comment Site Search Engine for 1,000 page website
+1. SolR has a learning curve, but it is amazingly powerful. Wouldn't think of using anything else for my sites.