In the Hypertext Transfer Protocol (HTTP), HTTP header fields contain the operating parameters of an HTTP request or response. With the request or response line (first line of message), they form the message header.

learn more… | top users | synonyms

1
vote
1answer
33 views

Vary: User-Agent in case of redirect?

Should we use Vary: User-Agent in our headers when the regular url www.mydomain.com is forwarded to m.mydomain.com? Or is it not needed for Google due the redirect?
1
vote
1answer
17 views

Earliest browsers that support if-modified-since or if-none-match headers

Based on my observations, google and probably many others are in love with websites that include the Etag and Last-modified headers along with the if-modified-since and if-none-match header checking ...
2
votes
1answer
34 views

Caching a changing site

I run a website where the static content changes at least 4 times a week and I'm trying to figure out the best header arrangement to use. Currently I have all caching related headers in use. I have ...
2
votes
1answer
38 views

Trying to add cache header to 301 pages made by ModRewrite

I have several URLs on my website that get redirected to other URLs using Mod-Rewrite. For example: RewriteRule ^section$ /newsection [NC,L,R=301] The above rule redirects ...
7
votes
1answer
102 views

If I only serve gzipped version of my content, should I add the vary accept encoding header?

I just moved a static site from a VPS to Amazon S3. I have decided to serve only gzipped version of my pages, since S3 is not a webserver I can't have logic based on headers. I also use Cloudfront as ...
0
votes
0answers
73 views

X-Robots-Tag: noindex on an HTTP 302 response to remove subdomain

This very related to this question "X-Robots-Tag: noindex" on an HTTP 301 response, however I don't see a definitive answer. We have subdomains we use for our affiliate links, the ...
0
votes
2answers
29 views

What is the proper response header when an address is not available but its parent is available and is displayed?

My website addresses has a hierarchy structure. When one page is requested, and it is not a valid address, it tries to find its parent, and if the later exists, it will show it. Now, my question is ...
6
votes
3answers
180 views

How should an expired content be handled?

Let's imagine this simplified case: An auction website has "auction detail" pages. A few weeks after the auction is over, the "auction detail" page is no more available. We are simply serving a ...
1
vote
1answer
140 views

Trailing slash on Root folder - Is it possible to remove it without 301?

I have noticed something very strange on the site I'm working on. We currently only show http://www.example.com. The URL http://www.example.com/ (slash at the end) gets 301ed to ...
5
votes
2answers
16k views

Font blocked from loading by Cross-Origin Resource Sharing policy: No 'Access-Control-Allow-Origin'

we are experiencing this error in Google Chrome. We thought everything was set-up correct. But maybe not? Font from origin http://skin.cdn.com has been blocked from loading by Cross-Origin ...
3
votes
2answers
507 views

CloudFlare Not Sending If-Modified-Since Headers

I'm trying to reduce my server load by providing 304 Not Modified responses for content where appropriate. CloudFlare is my middle man, so they should be sending If-Modified-Since headers whenever a ...
1
vote
0answers
190 views

Apache 404 Issue after upgrading from Mavericks to Yosemites

Good afternoon fellow StachExachangers, Background story: I have recently upgraded my macbook pro from Mavericks to Yosemites, everything went well except my local development environment got ...
1
vote
1answer
597 views

Caching of JS and CSS files – Apache mod_headers doesn’t take effect

As suggested by an answer on SO, I'm trying using a version number on my JS and CSS files so that the browser will only make a request when the JS or CSS version number is changed in my PHP file. To ...
0
votes
1answer
30 views

Does referrer header checking offer any real world security improvement?

At work we use a central portal that provides basic SSO functionality to other applications. In addition to verifying the SSO data sent, all of our existing in-house applications (used by the public) ...
1
vote
1answer
92 views

Did I use the proper way to remove pages from Google Webmaster Tools forever?

I have many pages from one year ago that were deleted and are returning a 404 error code, but two week ago after I cleared the content of my robots.txt, the errors in my Google Webmaster Tools reports ...
1
vote
2answers
302 views

Redirect to an affiliate using PHP or JavaScript redirect?

I was asked to introduce a unified self hosted URL-Shortener/Forwarder/Tracking Service for an website that earns money from affiliates. One example I found was one of the bigger german sites for ...
1
vote
1answer
147 views

Use different .htaccess file based on set header from browser

I want to have the ability to test .htaccess rules before saving them to the main .htaccess file. Is it possible to set a specific request header and have Apache use a set of rules from a different ...
0
votes
1answer
37 views

What is best practice for search engines when a website is under maintenance?

I need around a week to transition a heavily data-driven website from one back end to another. During that time I do plan to attempt to keep some pages live, but they won't all work well or look ...
2
votes
1answer
461 views

How to get keywords from Google HTTP referrer?

Can the http referrer URL from Google be decoded so that I can see the specific keywords? ...
1
vote
1answer
41 views

Can serving a different header code for crawlers and users be considered cloaking?

I have urls that point to pages I don't know yet if exist. Whenever reaching those, I perform a not-so-quick external sources check, and if exists generate the page on the fly. In order to avoid this ...
2
votes
1answer
582 views

Can I set Cache-Control in the .htaccess file for a specific part of a document (just a section of the <body>)

I noticed, by using Google Page Speed Insights, that if I structure my HTML to load the critical, above-the-fold content first, my page will improve performance - and it woks (with now current perf. ...
4
votes
1answer
1k views

Is it necessary to specify content-type in http response header?

Except for the html document, currently all the files (css, javascript and images) served from my web server do not specify the content-type in the http response header. I happen to notice this as I ...
4
votes
2answers
341 views

Why doesn't this web crawler obey requests to stop crawling my pages?

I have a hidden page that verifies internal payments from PayPal. The page has the following in its HTTP headers: X-Robots-Tag: noindex, nofollow But once in a while I see this in the page logs: ...
7
votes
1answer
279 views

Why is “29030400” seconds used as a common value for cache expiration?

I noticed that 29030400 is used very often in the Expires directives for static files. Google recommends to cache this kind of files up to 1 year (1 month at least). I did the math: 29030400 seconds ...
3
votes
1answer
243 views

Should we allow HEAD requests?

Our web application is predominantly read-only. As such we only allow GET requests. However, we regularly get errors in our logs because of user agents making HEAD requests. I've seen these come from ...
1
vote
1answer
230 views

Can a past Expires header value cause a site to not be indexed by Google?

I'm using this: <filesMatch "\.(html|htm|js|css)$"> FileETag None <ifModule mod_headers.c> Header unset ETag Header set Cache-Control "max-age=0, no-cache, no-store, ...
1
vote
1answer
189 views

how do we organize our site's (navigation) pages in Google search? [duplicate]

Is there a HTML technique for organizing my site's main pages in Google (navigation)? Or is it made by a Google's specific tool for creating a result layout like in this picture? Look at the ...
1
vote
1answer
3k views

IP Address headers (Remote_Addr) - When is this header sent by the browser?

I want to know when a browser includes the header - Remote_Addr in the HTTP request. I observed the request sent by the browser on loading stackoverflow.com, in the web console window of Firefox. ...
1
vote
1answer
493 views

Nginx Browser Caching using HTTP Headers outside server/location block

I am having difficulty setting the HTTP expires headers for Nginx outside of specific server (and then location) blocks. What I want is to something like the following: location ~* ...
1
vote
2answers
2k views

Is no cache meta tag bad for performance?

I see many websites, seemingly arbitrarily adding the no cache meta tag on every page. Like this: <META HTTP-EQUIV="PRAGMA" CONTENT="NO-CACHE"> <META HTTP-EQUIV="CACHE-CONTROL" ...
5
votes
1answer
609 views

How do Expires headers and cache manifest rules work together?

I find the W3C's official Offline Web Applications specification to be rather vague about how the cache manifest interacts with headers such as ETag, Expires, or Pragma on cached assets. I know that ...
4
votes
1answer
227 views

HTTP Headers caching

I am not totally sure bout HTTP headers, but from what I read its good to have some level of caching on static pages also I am not sure if Transfer Encoding: chunked is a good thing. I was not finding ...
2
votes
1answer
146 views

What's the best HTTP code for dynamically deleted pages?

I've built my own CMS and I'm looking for the best way to handle pages / items deletion. Actually, pages and items were deleted and cannot be restored. But since I have implemented a bin, I don't ...
2
votes
1answer
101 views

How to configure apache2 to just save certain POST requests without even passing them to application?

I'm running Apache in front of glassfish server using BalancerMember. For performance reasons I would like that POST requests on certain endpoint are just saved to a file without passing them to ...
2
votes
1answer
70 views

Why was 303 skipped in HTTP/1.0?

While looking back over HTTP response codes today I noticed that the 301, 302, and 304 response codes were defined in HTTP/1.0 but not the 303 response code. Does anyone know why the number 303 was ...
7
votes
1answer
148 views

Does the SPDY protocol eliminate the need for cookieless domains?

With plain HTTP, cookieless domains are an optimization to avoid unnecessarily sending cookie headers for page resources. However, the SPDY protocol compresses HTTP headers and in some cases ...
2
votes
1answer
3k views

Google Chrome audit: resources are explicitly non-cacheable?

If I run a Google Chrome audit on a site, it lists all CSS, PNG, JPG, JS files and even the main domain (i.e. www.example.com) under the heading: Leverage browser caching The following resources ...
7
votes
3answers
2k views

How to tell the Browser the character encoding of a HTML website regardless of Server Content-Type Header?

I have a HTML page that correctly (the encoding of the physical on disk matches it) announces it's Content-Type: <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> ...
0
votes
2answers
1k views

How to extract AdWords keywords from incoming traffic?

I have a landing page in which I need to understand what keywords are coming in from AdWords and then display some information based on this. I am not certain, but I don't believe that this ...
5
votes
3answers
1k views

What does it mean when a User-Agent has another User-Agent inside it?

Basically, sometimes the user-agent will have its normal user-agent displayed, then at the end it will have the "User-Agent: " tag displayed, and right after it another user-agent is shown. Sometimes, ...
5
votes
1answer
4k views

HTTP Header Cache Time: s-maxage and max-age

I am setting up a CDN for my website, I found the following sample for adding to the 'httpd.conf' file, this is used to adjust the cache-time for client and CDN: ExpiresActive On ExpiresByType ...
3
votes
3answers
308 views

PHP Include meta tags

A website I'm currently working on is http://www.troubi.com . Please don't care to look at the source code. If I validate the website through the w3cValidator a lot of errors occur all due to ...
9
votes
2answers
254 views

What should happen when content is deleted?

I am wondering about the standard handling of deleted data links from an application and an SEO perspective. I have an application where users can create content but they can also delete content. ...
3
votes
1answer
625 views

Sitemap file getting double compressed

I have a script that generates my XML sitemap and writes it to the file sitemap.xml.gz - i.e. an XML file, compressed with gzip. This file is definitely written correctly as when I download it via FTP ...
16
votes
1answer
5k views

What is recommended minimum object size for gzip performance benefits?

I'm working on improving page speed display times, and one of the methods is to gzip content from the webserver. Google recommends: Note that gzipping is only beneficial for larger resources. Due ...
14
votes
2answers
4k views

What are the Consequences for using Relative Location Headers?

According to the spec, Location headers used in a redirect require a server name HTTP/1.1 301 Moved Permanently ... Location: http://example.com/foo/baz/bar However, in 2012, most web browsers will ...
21
votes
2answers
17k views

difference between accept and content-type http headers

So the accept header tells the server the mime-type of the resource the browser is looking for. For example, the server can send plain text, html, json, etc. Ok that makes sense. But then I look at ...
1
vote
1answer
1k views

What response headers encourage 304-Not Modified upon reloads?

When looking at the network waterfall in Firebug/Chrome/IE9, I keep seeing "200-OK" instead of "304-Not Modified" for many cache-able files (images, js, css) on this page, for example. I believe it ...
1
vote
1answer
137 views

Site structure changes possibly led to ranking losses

Problem Last monday we changed our german only site from using wordpress to our own multi-lingual rails app. Since then our rankings dropped dramatically. I would like to know if the the recent ...
2
votes
2answers
1k views

How do I modify the HTTP headers?

Google page speed rank demands me to set an expiry date or a maximum age in the HTTP headers, by changing the "Expires" and "Cache-Control: max-age". The site is hosted on a hosting company (not in ...