Skip to main content

All Questions

Filter by
Sorted by
Tagged with
2 votes
1 answer
1k views

Can Google index page that is login-required and redirects to Login page?

I have one link that is login-required http://example.com/secret If user access the page without authentication it will be redirected to http://example.com/login page. My question is can Google bot ...
Quoc Lap's user avatar
0 votes
1 answer
2k views

Googlebot not respecting HTTP basic auth

I have basic auth set up and it has always worked. Suddenly Google started crawling my pages. The auth is still there (I have checked it using different browsers). I am at a loss how it's possible. ...
oshkosh's user avatar
  • 101
3 votes
4 answers
1k views

Personalized content (authenticated with a cookie) and impact on SEO

We have a big website with a lot of content, that is doing pretty well in terms of SEO. Google likes the site, visitors like it as well. Our problem is that there is a lot of content that would only ...
Denis Volovik's user avatar
7 votes
1 answer
2k views

Does htpasswd authentication prevent Google from crawling my site?

I have a site that I want to continue testing before I make public, so I don't want Google to start crawling the site as there will be a large amount of garbage content during testing. I currently ...
going's user avatar
  • 268