I support a website, www.questionexample.com, and I also have a test site setup for staging, staging.questionexample.com, on another server. They are essentially the same site and are not new.
For some reason, staging.questionexample.com is not listed or indexed in search engines and I'm not sure why? I don't want staging.questionexample.com to be listed, but I'm being asked why this is so? Our marketing team is worried about duplicate content. The production site shows up fine in search.
I'm sure staging is not listed because I search on Google and Bing for site:staging.questionexample.com and nothing returns, when I search for site:www.questionexample.com then all the pages are returned.
So far on staging.questionexample.com I've checked the following:
- robots.txt does not differ from the production site.
- There are no (meta name="robots" content="noindex") metatags on the staging pages.
- There is no "X-Robots-Tag = no-index" entry in HTTP Response Headers in IIS.
- There's no password to visit the staging site, anyone can visit it.
I am stumped as to why the staging site is not listed in search engines, even though that's what we want. However, I'd like to know why or where else to look to find out why it's completely not listed.