We’re rewarding the question askers & reputations are being recalculated! Read more.

All Questions

Tagged with
Filter by
Sorted by
Tagged with
1
vote
1answer
61 views

Google is ignoring meta tags and robots.txt

I have the following meta tags on my website (dev server): <meta name="robots" content="noindex"> <meta name="googlebot" content="noindex"> And I also configured a robots.txt (...
1
vote
1answer
116 views

Should tag and author pages be disallowed in robots.txt?

According to some articles that talk about crawl budget, we should decrease the number pages crawled and provide the only important and valuable pages to search engine crawlers. We have 3,000 ...
2
votes
1answer
40 views

Huge tables won't fit on mobile, can I tell Google the page is desktop only?

I'm working on a product comparison page that is composed of a giant table listing the attributes of a great many products. It's useful on a desktop for those who want to dig into the details of ...
4
votes
1answer
1k views

Google shows every page of my WordPress site but I only want the home page indexed

So to start with, I have Google crawl my (WordPress) website with the search console, now I can see my pages in the search engine. But it shows every page separately. Like my /contact, /services and /...
2
votes
2answers
262 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
2
votes
1answer
155 views

Hiding duplicate content - should I use meta tags or robots.txt?

Last week my site was utterly pummeled in Google's rankings - losing 95% of impressions overnight according to Google Webmaster Tools. It now only shows up if you search for the URL/site name itself. ...
1
vote
5answers
2k views

Can I include a robots meta tag outside of the head in HTML snippets indeded to be AJAXed?

I have a number of files in my site which are not intended for independent viewing, but rather to be AJAXed into content within the site. They obviously don't meet HTML standards (no body, head, etc.) ...
2
votes
1answer
217 views

Adsense and blocking robots from web pages

If I use a meta tag to make a page 'noindex' does this mean that my adsense ads will not be targeted?