10
votes
Accepted
How to avoid robots from indexing pages of my app through alternate URLs?
It happen that Googlebot discovers the alternate URL. The official way if you want your application to be accessible through all those URLs for internal purposes, is to use canonical links as you ...
- 6,007
10
votes
Accepted
How to allow Googlebot unlimited crawling but to have a limit on individual users?
Googlebot will be able to crawl your site fully because it never sends any cookies. There is, however, something else you need to do.
Google expects sites to implement limits on the amount of content ...
- 98.3k
10
votes
Accepted
Could a brand name called "Error 404" cause SEO issues?
You will be able to get your most of your content indexed, but there will probably be some SEO issues associated with that brand name. Google uses heuristics to determine if the page is an error page. ...
- 98.3k
9
votes
Accepted
Is it worthwhile to pay for boosting SEO for a new wesite?
Never pay for SEO services that guarantee results. Especially not quick results. Anything quick is going to be dirty. Such firms are likely going to:
Create links to your site from bad places
...
- 98.3k
7
votes
How to get tens of millions of pages indexed by Google bot?
I've had experience of just this sort of site. I ran an article directory many years ago and the % of pages indexed and more importantly actually performing was pretty much directly correlated to the ...
7
votes
Accepted
Is it bad for SEO to submit a partially finished site to Google?
There is no problem with showing Google a small site that you plan to add to later. If you have one page of good content, Google would like to index it because it could be useful to somebody ...
- 98.3k
7
votes
Accepted
Ampersand (&) in actual URL and sitemap
if this difference of ampersand in URL and sitemap will cause any issue.
tl;dr No issue, because the URLs are the same.
Since in sitemap & has to be escaped I replaced & with & ...
...
- 42.7k
7
votes
Accepted
How to tell bots to forget a website and reindex it from scratch
That isn't possible. You need to map your old URLs to the new with redirects for SEO and user experience.
Google never forgets about old URLs, even after a decade. When you migrate to a new CMS, ...
- 98.3k
7
votes
Accepted
Do SEO analysis bots have any advantage in terms of website traffic?
If you aren't using these services, then you can definitely block them. The data collected by these bots are only used within those specific tools and wouldn't affect your performance in organic ...
- 1,471
6
votes
Number of indexed pages with "site:" search less than reported in Google Webmaster Tools
You had posted this question differently twice. This answer was to the question marked as duplicate which I now post here hoping to help you. While the two questions may not be exactly the same, this ...
- 32.8k
6
votes
Huge drop off in Google "indexed" pages after switching to HTTPS, should I switch back to HTTP?
We just switched from HTTP to HTTPS two weeks ago, and after doing extensive research this is what we did:
Added the HTTPS property to our Search console.
Redirected HTTP robots.txt to HTTPS robots....
- 689
6
votes
Accepted
Is it possible for Google to disregard my canonical tag?
Early 2018 update to Google Search Console will now tell you if it's overridden a page with a different canonical:
Google chose different canonical than user: This URL is marked as canonical for a ...
- 3,207
5
votes
Best way to let Google index page with tabs - SEO
This is a very common problem faced these days. This can be easily solved as follows:
If you want to have same page /pets but also drive /pets/cats, /pets/dog to index separately, then ideally they ...
- 1,714
5
votes
Accepted
Redirecting robots.txt when moving to a new domain
This is really interesting question, It took me few minutes to search official statement from gary tweet..
When Google see 404/30X status, then Google will ignore your robots.txt completely. It is ...
- 5,507
5
votes
Why Google is indexing Thumbnails and not Large images?
The issue is that Google only sees one ALT tag therefore the other image is without description and will not rank in image search results.
If using a lightbox then preferably you should code or use ...
- 32.9k
5
votes
Accepted
How can I remove this URL from Google?
It looks like that you have affiliate links which have 302 redirected to the Amazon or another affiliate site. This is a common issue for affiliate websites.
The issue with 302 redirects is that ...
- 546
5
votes
Google indexed my home page with a completely wrong domain
There are two ways this can happen:
Another domain name points to your server. Your server is doesn't have a specific rule for that domain and defaults to serving the content of your main site.
...
- 98.3k
5
votes
Accepted
Google CSE has indexed robots.txt itself
You could add this to robots.txt:
Disallow: /robots.txt
In What if robots.txt disallows itself? Google's John Mueller says:
The only thing this would affect is if a link were pointing to the ...
- 98.3k
5
votes
Indexing pages with few text (like tags with just one article) is penalizing for the SEO?
The main issue with having too many tags is that CMS such as Wordpress or Blogger will create tag pages similar to category pages which can result to many similar thin content duplicate template pages ...
- 567
5
votes
Is setting the width and height of an SVG important for indexing?
While SVG's can be a purpose of their own, websites, accessibility readers and much of what you need to account for with SEO, is based on the standard IMG schema.
Because of this, it's best practice ...
- 314
5
votes
Accepted
Is it good for SEO to change an article's slug when changing its title?
Check out the URL of this very post on Stack Exchange, it's a great example of SEO-friendly slug+id addressing:
/questions/119694/is-it-good-for-seo-to-change-an-articles-slug-when-changing-its-title
...
- 15.8k
5
votes
How do i add custom fields in google search results?
That happens automatically. Google extracts what it thinks are key bits of information from the page, without needing any special markup or configuration on the site owner's part.
It's likely an ...
- 7,785
5
votes
Accepted
How should I choose which URLs I want indexed to include in my sitemap?
The pages you most want indexed are your post pages such as /blog/post-1. Those text-heavy pages with article-like content on them are the most attractive to search engines. Collectively, those ...
- 98.3k
5
votes
Accepted
How should we handle old URLs from a recently acquired expired domain that currently redirect to empty pages?
As long as your "empty" pages are correctly returning a 404 (or 410) status code, you should not have to worry about any ranking drop in the new domain.
Google will treat the URLs as removed ...
- 15.8k
5
votes
Screaming frog runs out of memory: will this affect crawling and ranking?
Screaming Frog uses your computer's memory, so lowering the amount of URLs crawled per second will likely help you. Will that get you through the whole site? I don't know. Perhaps just run it off a ...
- 6,221
5
votes
Stop any search engine from indexing/crawling images in a dedicated folder in wp
In your robots.txt file, assuming this folder is at the root, include the following:
User-agent: *
Disallow: /donotindex/
...
The ellipsis on line 3 simply stands in for any other Disallow or Allow ...
- 5,204
4
votes
How to get tens of millions of pages indexed by Google bot?
There are two Possible options I know of thay be of aome assistance.
One:
A little trick I tried with a website that had three million pages which worked surprisingly well was what my colleague ...
- 41
4
votes
Accepted
Are text links indexed by Google?
Google does index raw text links
Google and Bing will index a plain link as raw text just as it does with everything else. The page will however will need to be unique and offer something, otherwise ...
- 32.9k
4
votes
Accepted
Moving folder's content to a new domain, what SEO steps to take?
You have all the steps correct, but it won't prevent a temporary (up to 8 month) drop in SEO traffic.
Google does not support migrating an entire folder to its own new domain. When you do so, your ...
- 98.3k
4
votes
Huge drop off in Google "indexed" pages after switching to HTTPS, should I switch back to HTTP?
Are you checking the correct version of the search console? See the Google support site point 4: you need to add the https version as a new site. If you are still looking at the http version it's ...
- 366
Only top scored, non community-wiki answers of a minimum length are eligible