to customize your list.
more stack exchange communities
Start here for a quick overview of the site
Detailed answers to any questions you might have
Discuss the workings and policies of this site
How to block baidu spiders
Most of my visits are from baidu spiders. I don't think it helps search engines at all so I'm thinking of how to block them. Could this be done via iptables? I'm using nginx as my webserver.
Jul 9 '12 at 3:05
newest web-crawlers nginx questions feed
Hot Network Questions
Abstract Algebra Book Request
Generate random numbers without repetitions
Why is a woman allowed to get pregnant?
construction of nonmeasurable sets
What is the >>>= operator in C?
Was Dune originally a trilogy?
If a program terminates and there is no one to see it, does it halt?
"Ever change the value of 4?" - how did this come into Hayes-Thomas quiz?
Is Ubuntu Server only available with the command line?
License file issue with Tridion 2013 SP1
What is the point in having arbitrary username requirements?
Does Zen Buddhism have canonical texts?
Is it possible to travel around the world using JUST Low-cost carriers?
Solve second order ODE knowing one of its solutions
When does L' Hospital's rule fail?
How do I address a vertical postcard?
Why can't I `tail -f /proc/$pid/fd/1`?
Sophocles — "Success is dependent on effort"?
Which European cities are connected by convenient night boat?
What's the responsibility of an IPv6 owner?
How viable is a Wizard with 10 levels in Rainbow Servant as a melee combatant?
Where an ellipsis exists, is there a term for the missing text?
Can I configure error notifications on a specific cronjob entry to go to a different email address?
Why does a certain CSV file import properly into LibreOffice but not into Mathematica 10.0?
more hot questions
Life / Arts
Culture / Recreation
TeX - LaTeX
Unix & Linux
Ask Different (Apple)
Geographic Information Systems
Science Fiction & Fantasy
Seasoned Advice (cooking)
Personal Finance & Money
English Language & Usage
Mi Yodeya (Judaism)
Cross Validated (stats)
Theoretical Computer Science
Meta Stack Exchange
Stack Overflow Careers
site design / logo © 2014 stack exchange inc; user contributions licensed under
cc by-sa 3.0