Questions tagged [indexing]

The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

Filter by
Sorted by
Tagged with
7
votes
3answers
4k views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
2
votes
1answer
344 views

Google continues to index Word documents and PDF files that were blocked by robots.txt and have been removed from the server

I've been having some issues removing some content from Google's search results. I have some word documents and pdf files in public directories that I have since password protected. When you try to ...
-1
votes
1answer
165 views

How to block everything from being indexed except sitemap.xml

I want to block everything and index sitemap.xml file alone. So I do it as shown below: User-agent: * Disallow: / Allow: /sitemap.xml Sitemap: https://example.net/sitemap.xml However, I am not sure ...
2
votes
2answers
118 views

How do I prevent site from getting indexed when I buy the domain?

I am buying new domains, and as soon as I buy them I can find them indexed on google with "Domain Registered at Safenames" when I search site:domainname. Before I buy the domain, I google the domain ...
2
votes
4answers
797 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
1
vote
1answer
41 views

Changing domain through 301 redirects - will I lose ranking position?

I have a few articles that are in the top 3 of Google search results. They are currently accessed by the URL http://example.com/myarticle1. Now, I want to move that article to the other URL http://...
1
vote
1answer
169 views

Google Search Console - Scan Request does not work

I have a problem with Google's Search Console. When I "Fetch as Google" and status is Complete, I click on "Request Indexing", fill in the Captcha and Submit. Nothing happens after i click on Submit,...
2
votes
1answer
68 views

Parts of my site are not getting indexed after changing the URLs, adding redirects, and blocking the old URLs in robots.txt

I have a website with some URLs and later I optimized the URLs and changed the link structure. I blocked the old URLs with robots.txt and suggested redirections from old to new URLs, and then did ...
1
vote
2answers
40 views

How do I tell search engines that my content cannot load after sending an initial response?

In order to provide a better experience for users we have begun flushing our head section of our website well before we have accumulated and rendered the HTML to be sent to a client. This has many ...
2
votes
0answers
36 views

Will using same Google account hurt my new site if one site under my account is penalized?

Is there any problem for using same Google account if one of my site is penalized by Google? How carefully will my new site get looked over by Google. Would it be rigorous and the review of my new ...
3
votes
2answers
238 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
3
votes
3answers
110 views

How long before Google indexes a new (to me) domain that previously had spam and virus problems?

I registered a new ".com" domain, but when I added it to the Google Search Console I saw that there were problems with viruses and spam problems. I submitted a request for reconsideration. Google ...
4
votes
1answer
550 views

How do I tell which pages of my website are not indexed in Google?

Is there any way to find non-indexed pages of my website? I tried searching on-line for this answer but couldn't find the exact solution for how to find the non-indexed pages in Google. If I were ...
2
votes
1answer
315 views

Google takes 7 days to crawl and index new content despite submitting a site map in search console

I have WordPress site and i have submitted XML site map. It takes Google takes more than 7 days to crawl and index new content. There are no errors in Google Search Console with crawling or indexing. ...
2
votes
1answer
106 views

Are text sitemaps sufficient to get content indexed by Google or are XML sitemaps needed?

I am currently using sitemap.txt (Type: URL List) in Google Search Console. I am not using XML, just have added URLs line by line in notepad & saved as sitemap.txt. After uploading it to my site,...
2
votes
0answers
214 views

Google is adding “Archive” to the title of tag and category pages and not using the meta description

I am wondering why Google is indexing my tags and categories as archives. Is that OK to be like that or I should change them? How to change them? Actually it looks so awkward! I have configured my ...
0
votes
3answers
178 views

How to Re-Crawl My Website on Google?

I have one issue with my website. When I updated the meta title and description the first time, everything was fine and Google crawled the website within 24 hours. But now due to some keyword ...
1
vote
1answer
53 views

My website inner pages are not crawling and indexed?

My website is built with angular js. when i submitted sitemap only home page is indexed and remaining pages are not indexed. I already changed all my page urls # to #! . please suggest me .
1
vote
2answers
103 views

Will meta setting Meta=“NOINDEX” eventually remove page from Google index?

I am in the process of moving domains I still have alot of visitors coming to old domain (who are familiar with brand) so don't completely want to 301 it, but I would like pages from the old site to ...
1
vote
1answer
188 views

Does Having Too Many NoIndexed Pages Hurt Your Google Rankings?

I have a site like reddit. So 99% pages are thin content. I have no-index all pages. The quality articles are only blog posts written by our team ( Now have around 50 blog posts with 1000-2500 words)....
1
vote
1answer
72 views

How to Deal with Low Quality Content (Without Deleting or Adding More Content)?

I have around 95% low quality articles in my web site. I don't need to delete them because those are for users. I don't want to search engine traffic also those articles. Those articles just for loyal ...
2
votes
1answer
236 views

How long after fixing a crawl error in Bing Webmaster Tools before Bing recrawls and stops showing the error?

When will Bing recrawl my online shopping site? Yesterday I solved my site errors that were displayed in in Bing Webmaster Tools. I asked it to fetch those URLs. Bing webmaster tools still shows ...
2
votes
2answers
341 views

How to tell search engines to not index entire image domain without making them waste server bandwidth or making google complain

From what I learned, there's one way I could cause all URLs on a domain strictly serving images not to be indexed and that is with the x-robots-tag HTTP header. Now I check my logs and find out that ...
3
votes
1answer
771 views

Indexing Japanese links after hack

A few months ago our website got hacked, similar to what seems to be described in the following - https://developers.google.com/webmasters/hacked/docs/fixing_the_japanese_keyword_hack We fixed the ...
13
votes
3answers
4k views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
0
votes
1answer
172 views

Crawl error (Response Code 404) [closed]

Recently I've built my first website using WordPress and I'm having some trouble indexing it. As you guys can see, the site is working (http://contacontente.com), even though it doesn't have much ...
1
vote
1answer
31 views

Re-Indexing Home Page - HTML/DOM Change

(Site on WordPress) Currently, our company homepage is using images instead of divs to display our main products/solutions. As the SEO, I wanted to remove these images (which consist of mostly text) ...
2
votes
1answer
36 views

Accident with a lot of indexed pages - Google is not happy

We had more than 500 pages indexed, we are a relatively new site but I think we have good content so Google was ok with our pages. Most of this pages were profiles and had a url structure like /place/...
1
vote
2answers
860 views

Index content from a Bootstrap modal

I am using Bootstrap modal in my homepage. The content from the modals is not indexed by Google, while almost all other content in that page is indexed. How can I index modal content?
1
vote
1answer
221 views

Is sitemap in sitemap_index getting indexed by Google webmaster?

it sounds a silly question, but I actually could not find a reference to it. I have created a sitemap_index with about 100-ish sitemaps. No errors. I submitted only the sitemap_index to Google ...
2
votes
5answers
615 views

Ranked for main keyword on Bing and Yahoo but not on Google

My website is indexed by google (29000 pages indexed), I am not ranked at all for main keyword in google although: I am ranked in top 10 in Bing and Yahoo I am ranked for other keywords! I have ...
5
votes
4answers
152 views

How to make Google index users posts when there are no direct links and the posts are loaded with infinite scroll?

In a website that has posts system similar to Facebook, where the user has option to: Keep his posts private (needs login to view) Make them public (anyone can see them) In case #2 I want to allow ...
2
votes
1answer
25 views

Should article preview pages be crawled and indexed by search engines?

I have a page called "all articles" that loads previews of articles using AJAX. Because of that, the content won't be visible to search engines, so the page would be considered "poor content". Since ...
2
votes
2answers
428 views

Deleted website still appearing in Google search results

We deleted a website from our server around 3 weeks ago and the pages are still appearing in Google search results. Unfortunately we don't "own" the property in search console, so we can't suppress ...
1
vote
1answer
75 views

Will Google remove content such as images with canonical headers to other non-indexed content?

I've set a canonical (.htaccess) header from an image to another one. For instance: site.com/image-small.jpg has a canonical header to: site.com/image.jpg (Original image). However the website ...
0
votes
1answer
34 views

No results in google SERP [duplicate]

My website is showing 245 pages indexed in Google Search Console (formerly Webmaster Tools), but in Google SERP it is showing no results? My website is 2 months old, in GSC there are no crawl errors, ...
2
votes
1answer
220 views

Google not indexing New Forum

Over two months ago we installed a new forum system to our website. The new platform uses a different URL pattern, therefore we have installed a global 301 redirect, from old to new. We have updated ...
0
votes
1answer
1k views

Image still appears in google search results in spite it has been removed from original source

I have reported an image to google for removal under "remove outdated content" and in search console it says "This content is no longer live on the website", however the image still appears in google ...
1
vote
1answer
146 views

Does the below-mentioned server header impact google indexing?

Date: Sat, 04 Mar 2017 06:26:50 GMT Server: Apache/2.4.7 (Ubuntu) X-Powered-By: PHP/5.5.9-1ubuntu4.20 Expires: Sat, 01 Jan 2000 00:00:01 GMT Cache-Control: post-check=0, pre-check=0, max-age=0 Pragma: ...
1
vote
1answer
1k views

SEO friendly URL: hyphen vs forward slash [duplicate]

For example, I have a webshop where each product has its unique ID and I want to build SEO friendly URL for a product page. An old-school way that is mentioned almost in every article looks like this:...
1
vote
0answers
10 views

Geographical landing pages not showing up on Google search results [duplicate]

Problem we have: One markets' geographical landing pages do not appear on search results. Few months ago we discovered that robots.txt are blocking Google from indexing that markets' pages. We fixed ...
4
votes
2answers
3k views

Prevent indexing of image or file

I understand that you can do the following to generally prevent images or pages from getting indexed. Add to the page's meta section: <meta name="robots" content="noindex" /> Edit the robots....
2
votes
0answers
72 views

Which one is more SEO friendly Dynamic pages or static pages for blogging website

I am new to web development and I am developing a Blogging website. While working on its architecture from the SEO point of view, I came across a problem that whether I should create a seperate page ...
0
votes
1answer
106 views

Do search engines consider GUID in indexing?

I've been reading the WordPress's codex recently, and noticed that WordPress is using a term called GUID. According to codex: The term "GUID" stands for "Globally Unique Identifier". It is a field ...
0
votes
3answers
623 views

Schema.org markup taking too long to index

I run a doctor discovery platform. It has individual profiles for each doctor (over 700 profiles). I've added schema markup to the profiles. It's been more than 5 months and still not all the ...
5
votes
1answer
96 views

Implementing 301 redirects won't work without an existing file. Will that matter to Google or is there a better way to implement redirects?

I just published a completely revised version of a website (static site to a Wordpress powered one) without changing the domain or the web server. In the old site the URL structure was example.com/...
0
votes
1answer
187 views

Will “rel=canonical” pages be indexed?

So to give an overview of my application, I will have pages of various businesses (parents) and then each business will have additional pages of each business location (children). The plan is for ...
5
votes
1answer
205 views

Images not being shown in Google Image Search after redesign

We launched a new website design late February and since then 99% of our large product images do not show up on Google Image Search. We monitored the Image impressions after the launch of the new ...
1
vote
1answer
408 views

Drop in XML Sitemap Index Numbers in Google Search Console? [duplicate]

what is going on .. my sitemaps aren't index anymore... I have a really sudden decreasing in sitemap index
1
vote
0answers
52 views

Bing indexed pages decreased from 2400 to 2 in 5 days

Bing indexed pages decreasing rapidly.. Previously bing indexed pages was 2400 in search. Then I submitted sitemaps. After 4-5 days of submitting site maps .. Bing index starts decreasing from ...