Hot answers tagged

24

Yes, it's a caching reverse proxy. "It depends". By default only things like images and CSS are cached, but you can set the cache level per zone and set Page Rules to override what is cached or should not be cached. Static HTML can be forced to be cached by a page rule, but dynamic content obviously cannot. The exception here is if you have the Business or ...


8

Great question! This can actually be done, but it's relatively tricky. Tumblr has made it very clear that they don't want you to do this. They have silently broken CloudFlare integration a while back, where everyone who did this reverse proxy stuff with CloudFlare has basically gotten booted off of their custom domain name without any warning. (Keep in ...


5

Just to add a little more clarity: There's a pretty good article on Quora about how CloudFlare works. Which site resources are affected? Only static ones? What CloudFlare caches by default. "Does CloudFlare act as a cache proxy? Say, I have a bunch of images on the pages of my site. Does CloudFlare cache all those images on each of their data centers and ...


4

Here is what happens when a user makes a request to your site: They do a DNS lookup for yourdomain.example.com which tells them it is a CNAME of SOMETEXTXXXX.dv.googlehosted.com They do a DNS lookup for SOMETEXTXXXX.dv.googlehosted.com and get the IP address 192.0.2.4 The browser opens a HTTP connection to 192.0.2.4 and sends the header: host: yourdomain....


4

These are not fake and are used, these are private proxies used by staff members for various manual tasks/audits/reviews and should not be blocked...


4

I have also found that google proxy accessed my website several times (30+) in the very same second: 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249.81.106 - - [30/Aug/2013:01:26:35 +0200] "GET /index.php HTTP/1.1" 200 280329 66.249....


4

Your first log snippet suggests that the file may actually exist, since nginx response is 200, with 731 bytes of payload data, so, don't be too fast to have it blocked. However, if you want to have such requests omitted from logs, you can use the following in all servers affected: location = /wpad.dat { access_log off; log_not_found off; } Or, ...


4

Proxies run by national governments and ISPs will generally pass the carrier grade NAT (or in some cases, global) IPv4 address in the X-Forwarded-For header. Some proxies, such as those used by some UK ISPs to implement that country's censorship schemes, are transparent proxies, and the connection appears to come directly from the IP address of the end user,...


3

I did some research for this question and found some interesting thins, such as: 1. Is it a fake crawler? -> https://stackoverflow.com/questions/15840440/google-proxy-is-a-fake-crawler-for-example-google-proxy-66-249-81-131-google-c Conclusion from the user: These 'crawlers' are not crawlers but are part of the live website preview used in the Google ...


3

When a connection to a back-end server generates and error (default is any 5xx code) Apache marks that connection as in an Error State. Apache will then not use that connection for a period of time controlled by the retry parameter to ProxyPass. This defaults to 60 seconds. This means that unless you change it, once your back-end generates a 5xx return code,...


3

If you're tolerant of a bit of downtime, consider saving your backups to Amazon S3 (which can be done easily through cPanel) or another cloud provider in addition to /backup on the local machine. I lost a whole ~60 GB site in the recent Hostforweb meltdown that you were also caught up in, but was able to restore it to a new machine in 19 minutes, start-to-...


2

External Redirect If you are OK with editing the production .htaccess file then you could simply redirect requests for the necessary static assets to your local web server. The redirect would be conditional on the IP address accessing the site (ie. your external IP address). For example, to redirect a specific asset to the same URL-path on the local server:...


2

If you are using a javascript based analytics system such as Google Analytics they will not impact your analytics at all. However, if you are using a server based system, such as analyzing your log files, any proxied content will not show in your logs, rendering them very unreliable.


2

(from our emails, just to answer the question for future users) Looking at your last line (access log) it seems that people are exploiting a remote-file-inclusion hole, rather than proxying via Apache directly. But you can be sure of this by forcing all possible proxy capabilities to be disabled. You can try yourself to use your server as a proxy to access ...


2

There are services that will allow you to use their address and forward your mail to you at your usual address. This will make it appear as if you have a Canadian address, and you should be able to register the domain just fine. Alternatively, you could just find a Canadian citizen to register it for you. That way you can't be "found out", because the ...


2

There is service and it is called an CDN (Content Delivery Network). I personally use and recommend Cloudflare as its fast and free to some extent. The implication is that any server based programs detect the IP of the visitor as the IP of the CDN unless you make some changes. This would also help in better site speed. I you want to set up a reverse proxy, ...


2

If a user is using a proxy, there may be headers in the request that you could examine or log to let you know what the original IP address of the user is. See: X-Originating-IP X-Forwarded-For If you are using Apache server, headers such as this can be logged using %{header}i, in the log format configuration directive where "header" can be any HTTP request ...


2

Yes, it could still help. Although CloudFlare caches static content, it doesn't cache dynamic content served by your server, which could be of benefit as covered here. Some methods to use both in conjunction are covered here and here.


2

Check your Jetty configuration because although your "localhost" ProxyPass might take you to the proper host, the server itself may be configured to use the IP as a hostname (or not have the hostname configured properly at all). The behavior that you are describing about the URL also points in the same direction - your ProxyPass works but then the host is ...


2

It appears that the only thing that you would need to escape in that URL would be the : https://organization.proxive.se/proxive/https%3A//www.google.com/ Then your URL wouldn't use any disallowed characters and the directories would still be on the sub URL for supporting some relative links. I just want to point out that not all relative links will work. ...


2

If you prevent robots from indexing content, these websites are not considered as duplicate versions, and Google will ignore them. In fact, noindex is usually applied to "print version" of web articles. That's the most similar scenario. In other scenarios, I would suggest to use redirection or canonicalization. For the ads: it depends. You need to read the ...


2

You do not need to move a subdomain to a folder for SEO reasons. Content on subdomains can work great from an SEO perspective. See: Do subdomains help/hurt SEO? You won't be able to issue 301 redirects from the proxied pages. Your proxy needs those pages up and running to be able to work correctly. You you had page.example.com issue a 301 redirect ...


2

Based on your question and your clarification comment you would be better served using the URL rather than a header in order to best deal with downstream caching servers. In other words the first time you get the connection check the language header and then redirect them to the appropriate content via URL (something like www.domain.com/en/ or www.domain.com/...


2

There are multiple ways to do this: 1) Hosting it yourself What would be the cost involved You would need a second server, which would cost about the same as your current server How would I setup the DNS You can specify multiple A records pointing to different servers, and browsers should try them in order until it finds a running server. Advantages Your ...


2

Thanks @MrWhite for giving the correct configuration. I needed extra module mod_proxy_http and to change the IP adress of server-B to the hostname as I have multiple vHosts on :80. Here is the working configuration: <VirtualHost *:80> support.example.com LoadModule proxy_module modules/mod_proxy.so LoadModule proxy_http_module modules/...


1

Using the Standalone version for Youtrack (comes with Tomcat) and Apache, i've succeeded serving Youtrack from a subdirectory (/youtrack) with the following steps: Stop the Youtrack service if it's running Enable the AJP connector by uncommenting the following line in server.xml if it is commented (default: enabled) <Connector port="8009" protocol="AJP/...


1

You would also need to enable mod_proxy_html. ProxyPassReverse only rewrites the HTTP headers. To rewrite the content of the HTML (such as absolute links), you need to enable the additional module. The documentation for ProxyPassReverse states this pretty clearly: This directive lets Apache httpd adjust the URL in the Location, Content-Location and ...


1

What is the proper name for the middleware that fetches the information from the internal URL and serves it to the public API? A reverse proxy or gateway: A reverse proxy is a type of proxy server that retrieves resources on behalf of a client from one or more servers. These resources are then returned to the client as though they originated from ...


1

To add to Damon's response: You can find some helpful video tutorials for setting up the most popular/recommended Page Rules with CloudFlare here: cloudflare.com/features-page-rules Also, if you have maxed out your available Page Rules on your current plan you will soon be able to purchase additional rules without changing plans.


1

You can add the below line to the .htaccess file on server 1 so that it redirects all http requests to server 2. Redirect 301 / ip-address-of-server-2


Only top voted, non community-wiki answers of a minimum length are eligible