Hot answers tagged

23

Yes, it's a caching reverse proxy. "It depends". By default only things like images and CSS are cached, but you can set the cache level per zone and set Page Rules to override what is cached or should not be cached. Static HTML can be forced to be cached by a page rule, but dynamic content obviously cannot. The exception here is if you have the Business or ...


16

CloudFlare, in most cases, does not cache HTML. This is because we don't want to show stale dynamic content. That said, the system can help the performance of even dynamic content in four primary ways: CloudFlare can route traffic over preferred network routes that are often more efficient than what a request would normally take. For sites that get a lot of ...


8

Great question! This can actually be done, but it's relatively tricky. Tumblr has made it very clear that they don't want you to do this. They have silently broken CloudFlare integration a while back, where everyone who did this reverse proxy stuff with CloudFlare has basically gotten booted off of their custom domain name without any warning. (Keep in ...


7

To redirect requests for assets on your local machine only To get your local machine to use local files for certain JavaScript or CSS assets requested from a remote server, you could use an HTTP proxy/interception tool such as Charles. (Mac, Windows, and Linux. 30-day demo, then $50 to buy.) To set up Charles to listen for remote requests and serve local ...


5

You're correct. RED implemented the requirements from HTTPbis http://tools.ietf.org/html/draft-ietf-httpbis-p4-conditional-18#section-4.1. Normally, HTTPbis requirements are backwards-compatible with RFC2616 (i.e., they don't make implementations that were conformant to 2616 non-conformance now), but this change slipped through -- we'll be opening an issue ...


5

Just to add a little more clarity: There's a pretty good article on Quora about how CloudFlare works. Which site resources are affected? Only static ones? What CloudFlare caches by default. "Does CloudFlare act as a cache proxy? Say, I have a bunch of images on the pages of my site. Does CloudFlare cache all those images on each of their data centers and ...


4

Your first log snippet suggests that the file may actually exist, since nginx response is 200, with 731 bytes of payload data, so, don't be too fast to have it blocked. However, if you want to have such requests omitted from logs, you can use the following in all servers affected: location = /wpad.dat { access_log off; log_not_found off; } Or, ...


4

Here is what happens when a user makes a request to your site: They do a DNS lookup for yourdomain.example.com which tells them it is a CNAME of SOMETEXTXXXX.dv.googlehosted.com They do a DNS lookup for SOMETEXTXXXX.dv.googlehosted.com and get the IP address 1.2.3.4 The browser opens a HTTP connection to 1.2.3.4 and sends the header: host: yourdomain....


4

Proxies run by national governments and ISPs will generally pass the carrier grade NAT (or in some cases, global) IPv4 address in the X-Forwarded-For header. Some proxies, such as those used by some UK ISPs to implement that country's censorship schemes, are transparent proxies, and the connection appears to come directly from the IP address of the end user,...


3

These are not fake and are used, these are private proxies used by staff members for various manual tasks/audits/reviews and should not be blocked...


3

You could use a reverse proxy via mod_proxy. The Apache Httpd configuration would be along these lines: ProxyPass /6666/ http://localhost:6666/ <Location /6666/> ProxyPassReverse /6666/ Order deny,allow Allow from all </Location>


3

In fact, modproxy is the solution. Here's what I have done: Set up Wix site to a dummy URL (both in wix and in your DNS), e.g. www.dummy.com Set up an Amazon EC2 instance, in /etc/httpd/conf/httpd.conf <VirtualHost *:80> ServerName www.real.com ProxyPass / http://www.dummy.com/ </VirtualHost> point www.real.com to your EC2 restart ...


3

No, Last-Modified is not required, as you cited from RFC 2616. I've found this issue https://github.com/mnot/redbot/issues/61 in which they implemented the check for required headers. However, they stated in the issue that only "Date" was required, but the implementation was different (by mistake, I think).


3

That's not what the FAQ says: CloudFlare does not cache HTML, we only cache static files like images, CSS or Javascript. So if your HTML content is constantly changing, CloudFlare will not affect this content. It won't slow down your dynamic content–or help it, either–because they don't do anything with it. (If you read something else that conflicts ...


3

I did some research for this question and found some interesting thins, such as: 1. Is it a fake crawler? -> https://stackoverflow.com/questions/15840440/google-proxy-is-a-fake-crawler-for-example-google-proxy-66-249-81-131-google-c Conclusion from the user: These 'crawlers' are not crawlers but are part of the live website preview used in the Google ...


3

When a connection to a back-end server generates and error (default is any 5xx code) Apache marks that connection as in an Error State. Apache will then not use that connection for a period of time controlled by the retry parameter to ProxyPass. This defaults to 60 seconds. This means that unless you change it, once your back-end generates a 5xx return code,...


3

If you're tolerant of a bit of downtime, consider saving your backups to Amazon S3 (which can be done easily through cPanel) or another cloud provider in addition to /backup on the local machine. I lost a whole ~60 GB site in the recent Hostforweb meltdown that you were also caught up in, but was able to restore it to a new machine in 19 minutes, start-to-...


2

If you are using a javascript based analytics system such as Google Analytics they will not impact your analytics at all. However, if you are using a server based system, such as analyzing your log files, any proxied content will not show in your logs, rendering them very unreliable.


2

SSH Tunneling your connection will encrypt it, it's simple to setup and encrypted. Here is the article How To: Surf Securely with an SSH Tunnel


2

Stick with the same port. Port numbers are only used to initiate a connection, then they are moved to a pseudo-random port that's really high and likely not in use. The data transfer does not happen on port 80 for example. (To test this, run iptraf on your server and then download a large file from another computer. You'll notice that it's probably in the ...


2

External Redirect If you are OK with editing the production .htaccess file then you could simply redirect requests for the necessary static assets to your local web server. The redirect would be conditional on the IP address accessing the site (ie. your external IP address). For example, to redirect a specific asset to the same URL-path on the local server:...


2

(from our emails, just to answer the question for future users) Looking at your last line (access log) it seems that people are exploiting a remote-file-inclusion hole, rather than proxying via Apache directly. But you can be sure of this by forcing all possible proxy capabilities to be disabled. You can try yourself to use your server as a proxy to access ...


2

There are services that will allow you to use their address and forward your mail to you at your usual address. This will make it appear as if you have a Canadian address, and you should be able to register the domain just fine. Alternatively, you could just find a Canadian citizen to register it for you. That way you can't be "found out", because the ...


2

I have also found that google proxy accessed my website several times (30+) in the very same second: 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249....


2

There is service and it is called an CDN (Content Delivery Network). I personally use and recommend Cloudflare as its fast and free to some extent. The implication is that any server based programs detect the IP of the visitor as the IP of the CDN unless you make some changes. This would also help in better site speed. I you want to set up a reverse proxy, ...


2

If a user is using a proxy, there may be headers in the request that you could examine or log to let you know what the original IP address of the user is. See: X-Originating-IP X-Forwarded-For If you are using Apache server, headers such as this can be logged using %{header}i, in the log format configuration directive where "header" can be any HTTP request ...


2

Yes, it could still help. Although CloudFlare caches static content, it doesn't cache dynamic content served by your server, which could be of benefit as covered here. Some methods to use both in conjunction are covered here and here.


2

Check your Jetty configuration because although your "localhost" ProxyPass might take you to the proper host, the server itself may be configured to use the IP as a hostname (or not have the hostname configured properly at all). The behavior that you are describing about the URL also points in the same direction - your ProxyPass works but then the host is ...


2

It appears that the only thing that you would need to escape in that URL would be the : https://organization.proxive.se/proxive/https%3A//www.google.com/ Then your URL wouldn't use any disallowed characters and the directories would still be on the sub URL for supporting some relative links. I just want to point out that not all relative links will work. ...


2

If you prevent robots from indexing content, these websites are not considered as duplicate versions, and Google will ignore them. In fact, noindex is usually applied to "print version" of web articles. That's the most similar scenario. In other scenarios, I would suggest to use redirection or canonicalization. For the ads: it depends. You need to read the ...


Only top voted, non community-wiki answers of a minimum length are eligible