133 reputation
118
bio website
location Barcelona, Spain
age
visits member for 2 years, 6 months
seen Oct 2 '13 at 14:53

Freelancer developer. I´m based in Barcelona,Spain


Sep
24
awarded  Autobiographer
Nov
12
awarded  Famous Question
Oct
2
awarded  Quorum
May
21
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
thanks, I'll this this approach.
May
20
awarded  Commentator
May
20
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
@TomD I'm using Apache.
May
20
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
@ArttuRaittila I get my server collapsed due to these bots. I can't afford to pay for a better server right now. So, I need to limit these bots.
May
20
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
@ArttuRaittila : same comment as for Fiasco.
May
20
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
@FiascoLabs: there are at least 7 user agents whose don't observe Crawl-Delay value. I don't want to register, login, and understand their tool to get this. There must be another way to make the Crawl-Delay works. I just reformulate my question to see if this can be done in htaccess file.
May
20
revised How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
improved question
May
20
revised How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
edited title
May
20
revised How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
change the title to include question about htaccess
May
20
comment How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
Just wondering if I can manage the "Crawl-Delay" in .htaccess file?
May
19
asked How to make “crawl-delay” works for all “user-agent” in robots.txt or in .htaccess?
Nov
15
awarded  Notable Question
Aug
28
awarded  Popular Question
May
17
awarded  Scholar
May
17
comment How to set suhosin.post.max_vars in a htaccess file
working. thanks
May
17
accepted How to set suhosin.post.max_vars in a htaccess file
May
17
awarded  Editor