5 votes
Accepted

How does changing an HTTP referrer header help circumvent crawler blocking

The idea would be to make your requests look as much like a real browser as possible. Real browsers send referrer headers. You'd want to send referrer headers that look as much as possible like ...
Stephen Ostermiller's user avatar
4 votes

How to make a bot in Windows that does automated search of domain names to see if they are available?

Here's a bash script for it. Put your domain names to check in domains.txt, one domain per line, then run the script. #!/bin/bash DOMAINS=~/domains.txt while read -r domain; do whois $domain | ...
Maximillian Laumeister's user avatar
2 votes
Accepted

Trying to install web2py on a shared server (Dreamhost)

Well, I wasn't able to get things working following this tutorial, and many tests and variations. Finally, I found a very interesting link in the uWSGI site, which actually made things work! The only ...
jcoppens's user avatar
  • 171
2 votes
Accepted

Is it possible to host my website on digitalocean.com without having to push my project on github?

A droplet is a virtual machine hosted at Digitalocean. You shouldn't need to push code through Github to connect to it. Digitalocean has instructions for ssh access to a droplet. With ssh access, you ...
Stephen Ostermiller's user avatar
1 vote

How to access Windows XAMPP localhost website using Python

Ok, not an actual answer but rebooted and restarted XAMPP and the problem has vanished - at least for now. Unknown is whether or not this was a one-time event specific to my system and some sequence ...
Jim's user avatar
  • 51
1 vote

How to make a bot in Windows that does automated search of domain names to see if they are available?

Here is a video explanation exactly with python and selenium https://www.youtube.com/watch?v=7wB3cTma0xs
manqlele's user avatar
1 vote

Adsense on website that scrapes data from Instagram

The AdSense terms of service prohibit serving ads on pages with content that violate copyright laws. See the section on "Intellectual property abuse." To show ads on content from Instagram, you ...
Stephen Ostermiller's user avatar
1 vote
Accepted

Setting up and running Python scripts on my shared hosting plan

All you should have to do is upload your .py scripts via FTP, just like you would with .php, .css, .js etc. scripts.
Steve's user avatar
  • 8,458
1 vote

Matomo outputs "hostname X doesn't match Y"

Figured out that this is a SSL verification issue. Older python versions don't validate ssl certificates at all, thus the one matomo instance was working fine and the other not. The exception is ...
dr0i's user avatar
  • 129
1 vote

Parse Python script on Apache virtual host

I didn't use mod_python yet, but it seems to me that the script is expected to return (rather than print) the text to be served, and to contain an index function to accomplish this. If you don't ...
Tobias's user avatar
  • 165
1 vote

Is there a scripting or command-line interface to the Apache mod_info module?

There is no command line interface into the two modules you have mentioned. They are designed to be output to the browser by creating a location entry in the conf file and using the SetHandler ...
Chris Rutherfurd's user avatar
1 vote
Accepted

updating SQL tables every x seconds (the right way)

In this instance you have taken the option that is the best practice and is what is done by most websites that have to run tasks at regular intervals. What it boils down to is you are using the ...
Chris Rutherfurd's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible