Questions tagged [indexing]

The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

Filter by
Sorted by
Tagged with
2
votes
1answer
4k views

How long for Google to index pages after submit to index? How to check the progress? [duplicate]

After a revamp of our website, I have submitted an updated sitemap then fetched the homepage URL / as Google and submitted it and its direct links for indexing in Google Search Console more than 2 ...
1
vote
0answers
156 views

Google reports almost nothing from the sitemap is indexed even though millions of pages are indexed overall

In google webmaster tools, I am seeing a very big discrepancy between Crawl >>> Sitemap >>> indexed and Google Index >>> Index Status although when i search on google for site:mysite.com, it ...
2
votes
0answers
55 views

though 301 website redirect from .de to .com, google indexes .de Website

I had a website example.de . Than I changed the domain with example.com . I added example.com also in google search console and than I did every steps in https://support.google.com/webmasters/answer/...
2
votes
1answer
342 views

Google continues to index Word documents and PDF files that were blocked by robots.txt and have been removed from the server

I've been having some issues removing some content from Google's search results. I have some word documents and pdf files in public directories that I have since password protected. When you try to ...
-1
votes
1answer
153 views

How to block everything from being indexed except sitemap.xml

I want to block everything and index sitemap.xml file alone. So I do it as shown below: User-agent: * Disallow: / Allow: /sitemap.xml Sitemap: https://example.net/sitemap.xml However, I am not sure ...
2
votes
2answers
116 views

How do I prevent site from getting indexed when I buy the domain?

I am buying new domains, and as soon as I buy them I can find them indexed on google with "Domain Registered at Safenames" when I search site:domainname. Before I buy the domain, I google the domain ...
1
vote
2answers
479 views

How can I stop Google from indexing “pretty links” external redirects from my WordPress site?

When I search site:[example].com in Google for my blog, the majority of the pages that are being indexed are "pretty links" to external sites. I created these links using the Pretty Links plugin so ...
1
vote
1answer
40 views

Changing domain through 301 redirects - will I lose ranking position?

I have a few articles that are in the top 3 of Google search results. They are currently accessed by the URL http://example.com/myarticle1. Now, I want to move that article to the other URL http://...
2
votes
1answer
68 views

Parts of my site are not getting indexed after changing the URLs, adding redirects, and blocking the old URLs in robots.txt

I have a website with some URLs and later I optimized the URLs and changed the link structure. I blocked the old URLs with robots.txt and suggested redirections from old to new URLs, and then did ...
1
vote
2answers
40 views

How do I tell search engines that my content cannot load after sending an initial response?

In order to provide a better experience for users we have begun flushing our head section of our website well before we have accumulated and rendered the HTML to be sent to a client. This has many ...
2
votes
0answers
36 views

Will using same Google account hurt my new site if one site under my account is penalized?

Is there any problem for using same Google account if one of my site is penalized by Google? How carefully will my new site get looked over by Google. Would it be rigorous and the review of my new ...
1
vote
1answer
280 views

Why has Google indexed the same page twice for my site?

Google has indexed the same page twice For my website. I am not able to figure out the solution for this issue. Can anybody help me to solve this problem? I am attaching screenshots below for the ...
2
votes
1answer
309 views

Google takes 7 days to crawl and index new content despite submitting a site map in search console

I have WordPress site and i have submitted XML site map. It takes Google takes more than 7 days to crawl and index new content. There are no errors in Google Search Console with crawling or indexing. ...
4
votes
1answer
547 views

How do I tell which pages of my website are not indexed in Google?

Is there any way to find non-indexed pages of my website? I tried searching on-line for this answer but couldn't find the exact solution for how to find the non-indexed pages in Google. If I were ...
2
votes
1answer
104 views

Are text sitemaps sufficient to get content indexed by Google or are XML sitemaps needed?

I am currently using sitemap.txt (Type: URL List) in Google Search Console. I am not using XML, just have added URLs line by line in notepad & saved as sitemap.txt. After uploading it to my site,...
2
votes
0answers
206 views

Google is adding “Archive” to the title of tag and category pages and not using the meta description

I am wondering why Google is indexing my tags and categories as archives. Is that OK to be like that or I should change them? How to change them? Actually it looks so awkward! I have configured my ...
3
votes
3answers
110 views

How long before Google indexes a new (to me) domain that previously had spam and virus problems?

I registered a new ".com" domain, but when I added it to the Google Search Console I saw that there were problems with viruses and spam problems. I submitted a request for reconsideration. Google ...
5
votes
2answers
2k views

Redirecting robots.txt when moving to a new domain

I'm moving a site to a new domain, to a local tld. I already redirected everything successfully to the new domain, except the robots.txt. My question would be that is it needed to redirect the ...
1
vote
1answer
185 views

Does Having Too Many NoIndexed Pages Hurt Your Google Rankings?

I have a site like reddit. So 99% pages are thin content. I have no-index all pages. The quality articles are only blog posts written by our team ( Now have around 50 blog posts with 1000-2500 words)....
1
vote
1answer
72 views

How to Deal with Low Quality Content (Without Deleting or Adding More Content)?

I have around 95% low quality articles in my web site. I don't need to delete them because those are for users. I don't want to search engine traffic also those articles. Those articles just for loyal ...
2
votes
1answer
236 views

How long after fixing a crawl error in Bing Webmaster Tools before Bing recrawls and stops showing the error?

When will Bing recrawl my online shopping site? Yesterday I solved my site errors that were displayed in in Bing Webmaster Tools. I asked it to fetch those URLs. Bing webmaster tools still shows ...
1
vote
1answer
52 views

Link to product detail pages without allowing product list pages with many filter variants to all be indexed

I have a website for managing trading card game (TCG) collections which is built around a central search engine/filter system. This filter system is located on the cards page which lists all cards ...
1
vote
1answer
62 views

Does Google index or see data used by JavaScript in a hidden <p>?

I'm working on a site that has a speedbump set up to give a disclaimer when visitors leave our site for another. We then have a whitelist of URLs for external sites where this speedbump does not pop ...
3
votes
1answer
764 views

Indexing Japanese links after hack

A few months ago our website got hacked, similar to what seems to be described in the following - https://developers.google.com/webmasters/hacked/docs/fixing_the_japanese_keyword_hack We fixed the ...
0
votes
1answer
170 views

Crawl error (Response Code 404) [closed]

Recently I've built my first website using WordPress and I'm having some trouble indexing it. As you guys can see, the site is working (http://contacontente.com), even though it doesn't have much ...
1
vote
1answer
53 views

My website inner pages are not crawling and indexed?

My website is built with angular js. when i submitted sitemap only home page is indexed and remaining pages are not indexed. I already changed all my page urls # to #! . please suggest me .
1
vote
1answer
31 views

Re-Indexing Home Page - HTML/DOM Change

(Site on WordPress) Currently, our company homepage is using images instead of divs to display our main products/solutions. As the SEO, I wanted to remove these images (which consist of mostly text) ...
1
vote
1answer
168 views

Google Search Console - Scan Request does not work

I have a problem with Google's Search Console. When I "Fetch as Google" and status is Complete, I click on "Request Indexing", fill in the Captcha and Submit. Nothing happens after i click on Submit,...
2
votes
1answer
36 views

Accident with a lot of indexed pages - Google is not happy

We had more than 500 pages indexed, we are a relatively new site but I think we have good content so Google was ok with our pages. Most of this pages were profiles and had a url structure like /place/...
2
votes
1answer
151 views

Screaming Frog removes custom request headers

We are working on an Angular SPA that uses token-based authentification (our client app gets a token from the server and saves it to localstorage). Then in each request to our API the client adds a ...
2
votes
5answers
605 views

Ranked for main keyword on Bing and Yahoo but not on Google

My website is indexed by google (29000 pages indexed), I am not ranked at all for main keyword in google although: I am ranked in top 10 in Bing and Yahoo I am ranked for other keywords! I have ...
2
votes
1answer
25 views

Should article preview pages be crawled and indexed by search engines?

I have a page called "all articles" that loads previews of articles using AJAX. Because of that, the content won't be visible to search engines, so the page would be considered "poor content". Since ...
5
votes
4answers
152 views

How to make Google index users posts when there are no direct links and the posts are loaded with infinite scroll?

In a website that has posts system similar to Facebook, where the user has option to: Keep his posts private (needs login to view) Make them public (anyone can see them) In case #2 I want to allow ...
2
votes
2answers
424 views

Deleted website still appearing in Google search results

We deleted a website from our server around 3 weeks ago and the pages are still appearing in Google search results. Unfortunately we don't "own" the property in search console, so we can't suppress ...
1
vote
1answer
74 views

Will Google remove content such as images with canonical headers to other non-indexed content?

I've set a canonical (.htaccess) header from an image to another one. For instance: site.com/image-small.jpg has a canonical header to: site.com/image.jpg (Original image). However the website ...
0
votes
1answer
34 views

No results in google SERP [duplicate]

My website is showing 245 pages indexed in Google Search Console (formerly Webmaster Tools), but in Google SERP it is showing no results? My website is 2 months old, in GSC there are no crawl errors, ...
1
vote
2answers
847 views

Index content from a Bootstrap modal

I am using Bootstrap modal in my homepage. The content from the modals is not indexed by Google, while almost all other content in that page is indexed. How can I index modal content?
3
votes
1answer
348 views

Google Search Console “Indexed Pages” spike and traffic loss after image CDN switch

Back on 2/7, we changed CDNs from Amazon Cloudfront to StackPath for the images on our popular sports website. We ticked off the "use canonical headers" option when doing so. Starting on 2/12, we ...
1
vote
1answer
145 views

Does the below-mentioned server header impact google indexing?

Date: Sat, 04 Mar 2017 06:26:50 GMT Server: Apache/2.4.7 (Ubuntu) X-Powered-By: PHP/5.5.9-1ubuntu4.20 Expires: Sat, 01 Jan 2000 00:00:01 GMT Cache-Control: post-check=0, pre-check=0, max-age=0 Pragma: ...
1
vote
1answer
1k views

SEO friendly URL: hyphen vs forward slash [duplicate]

For example, I have a webshop where each product has its unique ID and I want to build SEO friendly URL for a product page. An old-school way that is mentioned almost in every article looks like this:...
1
vote
0answers
10 views

Geographical landing pages not showing up on Google search results [duplicate]

Problem we have: One markets' geographical landing pages do not appear on search results. Few months ago we discovered that robots.txt are blocking Google from indexing that markets' pages. We fixed ...
4
votes
2answers
3k views

Prevent indexing of image or file

I understand that you can do the following to generally prevent images or pages from getting indexed. Add to the page's meta section: <meta name="robots" content="noindex" /> Edit the robots....
2
votes
0answers
72 views

Which one is more SEO friendly Dynamic pages or static pages for blogging website

I am new to web development and I am developing a Blogging website. While working on its architecture from the SEO point of view, I came across a problem that whether I should create a seperate page ...
4
votes
1answer
350 views

Is it possible for Google to disregard my canonical tag?

I was wondering if it is possible for Google to disregard the canonical tag, if for example they decide it is wrongly put based on behavioral data. On my blog's individual blog posts there is a ...
0
votes
1answer
105 views

Do search engines consider GUID in indexing?

I've been reading the WordPress's codex recently, and noticed that WordPress is using a term called GUID. According to codex: The term "GUID" stands for "Globally Unique Identifier". It is a field ...
3
votes
2answers
2k views

Does rel=“next” have to be in the HEAD?

I'm trying to improve SEO on a platform i'm working with, and was advised to add rel="next" and rel="prev" links to my pages to make it clearer to google which URLS are paginated. My question to you ...
5
votes
1answer
96 views

Implementing 301 redirects won't work without an existing file. Will that matter to Google or is there a better way to implement redirects?

I just published a completely revised version of a website (static site to a Wordpress powered one) without changing the domain or the web server. In the old site the URL structure was example.com/...
0
votes
1answer
186 views

Will “rel=canonical” pages be indexed?

So to give an overview of my application, I will have pages of various businesses (parents) and then each business will have additional pages of each business location (children). The plan is for ...
1
vote
1answer
408 views

Drop in XML Sitemap Index Numbers in Google Search Console? [duplicate]

what is going on .. my sitemaps aren't index anymore... I have a really sudden decreasing in sitemap index
1
vote
0answers
52 views

Bing indexed pages decreased from 2400 to 2 in 5 days

Bing indexed pages decreasing rapidly.. Previously bing indexed pages was 2400 in search. Then I submitted sitemaps. After 4-5 days of submitting site maps .. Bing index starts decreasing from ...