I bet google is checking web pages via HTTP HEAD and HTTP GET request methods. So I'm thinking I should also allow proper header output for downloadable files from my website via HTTP HEAD request but no documentation tells me the proper way to go.
Currently this is my HTTP header for a downloadable file when one requests it from my server with either a GET or HEAD request method:
HTTP/1.1 200 OK Date: Sun, 06 Sep 2015 06:11:29 GMT Server: Apache Set-Cookie: CC=something;path=/;domain=example.com;expires=Tue, 06 Oct 2015 06:11:29 GMT X-Robots-Tag: noindex cache-control: max-age=864000,must-revalidate Last-Modified: Sun, 06 Sep 2015 02:39:19 GMT content-disposition: attachment; filename="HQ_Photo8.jpg.gz" Content-Length: 251085 X-Frame-Options: DENY Accept-Ranges: bytes Content-Type: application/gzip
What headers should I add or remove to comply to standards when someone requests the download via a HEAD request method?
I read with a standard html document that when one requests it with a HEAD method that the "content-length" header should be removed, but since this is a downloadable file I'm dealing with, I think its more involved.