Questions tagged [indexing]

The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

Filter by
Sorted by
Tagged with
2
votes
4answers
137 views

How to remove indexed pages from google effectively

My site was getting traffic and it was on the rise, then I added https and somewhere in that time I also created tons of extra link for google to crawl, thinking this will increase traffic in those ...
6
votes
5answers
7k views

Why are URLs with my domain name at the end showing up in analytics?

I have a multi-language WordPress site that has been live since the last 3 months and today when I checked Analytics, I saw a lot of weird URLs: /menswear-fashion-autumn-winter-2013-2014/www.domain....
4
votes
2answers
1k views

Informing Google of URL Structure Change

I have a website and the URLS were constructed like so: /index.php/Topic /index.php/AnotherTopic These were indexed in google and search results returned that pointed to these. However, I've ...
0
votes
0answers
28 views

Some links are indexable and some others are not when they are all created equal, why?

I'm trying to create a sitemap. I'm using the Screaming Frog software, but I think that this can be achieved in different ways with other software as well. My links are generated with different ...
2
votes
1answer
52 views

Index Coverage Status: “Submitted and indexed”, except it isn't

A couple of months ago I created a new property in the Google Search Console. We all know: Google takes his time and I patiently waited, checked now and then, until the status of my sites were updated ...
1
vote
2answers
21 views

Does blocking URL parameters in Google Search Console remove pages from index?

In GSC there is a possibility of telling Google how to deal with URL parameters. Google suddenly started to index 600k+ URLs with parameters on our website. I have set the parameter in GSC as ...
-1
votes
3answers
24 views

How to remove bulk urls from google index

I have URLs indexed by Google and I want to remove them from indexing. I found that I can use bulk remove option by providing a CSV file including all indexed URLs to Google Search Console. I have ...
1
vote
0answers
11 views

Limit search engines to indexing just one domain when multiple domains share the same web server and document root

I have multiple domains listening on same ports and sharing same document root. This is a limitation of my hosting provider that lets me have multiple domains for my GSuite mail routing without using ...
1
vote
0answers
36 views

Do deindexed URLs pass link juice? [duplicate]

I am building some backlinks to a page of my website that is high likely to get deindexed (I have to build to that specific page) mainly because of duplicate content. Will my page, if deindexed, pass ...
0
votes
1answer
42 views

Robots.txt, php.ini, .htaccess, etc

This will be my first website, so I am completely new to all of this. I cannot seem to find an answer anywhere, as to whether or not I should disallow configuration files like /php.ini or hidden ...
3
votes
2answers
1k views

Can Angular project be indexed in Google without Angular Universal?

I'm working on an Ionic PWAprogressive web app (PWA) and forthere are reasons iI cannot use Angular Universal. Is there any way to index with success inget Google to successfully index the site ...
1
vote
1answer
84 views

Google selecting wrong canonical

This page addresses the question of duplicate content, but does not describe what I'm facing. After first encountering the Google "canonical algorithm bug" 2 months ago, I've made only a little ...
0
votes
1answer
19 views

Prevent Duplicate Google Indexing When Moving From www to non-www (Search Console)

I want to move my website away from using the www subdomain. I am using Squarespace which will provide automatic 301 redirects for all pages on the www subdomain to the non-www. I have a sitemap ...
1
vote
1answer
373 views

Index manager in cpanel. Do contents still get indexed with “No Indexing”?

Simple question. A folder, lets say for example abc.com/images/ Is being displayed on google as "index of", which I don't like. The contents of this folder are important, and it is important that ...
2
votes
0answers
547 views

URL will be indexed only if certain conditions are met

I've got a few pages of my site that are coming up in G Webmaster Tools with errors. The pages are fully working, not restricted by noindex or robots.txt file. The pages don'r have a lot of content, ...
0
votes
1answer
21 views

Google indexing Wordpress in subdirectory disallowed in robots.txt

I have a headless wordpress site just using wordpress API. My site is in the root at example.com, and wordpress live subdirectory example.com/wordpress. I set up robots.txt as follows: User-agent: *...
4
votes
1answer
47 views

UK/USA Exact Copy English Causing Error “Duplicate submitted url not set as canonical”

starting around February 25th, 2019 we have been having pages excluded from indexing for our UK website with the error "Duplicate, submitted URL not selected as canonical". We have not had this issue ...
0
votes
0answers
9 views

Preferred method of indexing words with diacritics

I have lots of pages using foreign words, transliterated into their latin equivalent, using a vareity of diacritics. Some example of such characters: ā, ṛ, ṭ and ḥ. As for words: Vṛkṣa can be ...
0
votes
0answers
19 views

Duplicate, Google chose different canonical than user for - international website

I manage a group of international websites for one brand and each country website is on a subdomain (in this format: au.website.com) My problem is that Google has excluded the country websites from ...
5
votes
6answers
265 views

How do you prevent web pages from appearing in the Google search index?

I have some web pages that Google has indexed. I have now added a robots.txt file to exclude them, but should I also add a noindex tag? If so, then how do I do so?
0
votes
0answers
13 views

How does googlebot indexing javascript mixed links (href & onclick on same element)

It's been about 5 years since google indexing javascript and I'm still confused about details. I read here ( Does Google perform onClick actions? ) basics. And then I know that javascript created ...
0
votes
1answer
90 views

Google Scholar Content Gone

The content on my website was on Google Scholar but now is gone. We added the citation_title class to the element containing our articles titles. We also modified the style of that class so it is the ...
1
vote
0answers
29 views

Is anyone else seeing massive deindexes over Memorial Day weekend 2019?

Is anyone else seeing massive deindexes over Memorial Day weekend 2019? When I'm doing a site search it's saying that I have 4,500 pages indexed in Google, though on Google Search Console says 14,550....
0
votes
0answers
25 views

Invalid traffic coming from Sogou

I have not indexed my website in Sogou. I have only very less visitors. But i am getting traffic from Sogou daily. The search keyword is "site:mywebsitename" and is from China. Just visiting main page....
2
votes
1answer
39 views

Do search engines crawl links with query strings?

If I were to have a url like https://example.com/books, that contained several links to urls such as: https://example.com/books?id=foo https://example.com/books?id=bar https://example.com/books?id=...
2
votes
1answer
21 views

De-indexing microsites in Google

I need to de-index some content from Google. We have a main domain main.example.com which has listing of E-commerce products. Also, we give this for internal use to companies on their subdomain. ...
2
votes
0answers
31 views

After redirecting to canonical domain and HTTPS, Google Search Console reports most of my pages are now excluded

In Google Search Console - Coverage for one of my sites it says : Error 0 Valid with warnings 22 Valid 10 Excluded 11.1k Expanding Excluded, it's 6,000 for pages with redirect and 3,400 with a soft ...
1
vote
1answer
33 views

Do search engines index folders and subfolders regardless of pages?

I know search engines first index the main page, then follow by its links and do the same with the pages by the links as the main page before. Ok, but what about folders and subfolders? Do search ...
2
votes
0answers
12 views

Video thumbnails Issue in SERP just for Unicode URLs

I tested many times and I made sure that Google not interested to show my thumbnails of video when I have URLs with non-English characters. When I rollback canonical and internal links to English ...
1
vote
1answer
621 views

Allow Google to index content loaded by AJAX when clicked

I have read many articles about how Google handles AJAX loaded content, and I am aware that Google is now supposed to index your page like any modern browser now. However, I am still seeing much of ...
1
vote
0answers
26 views

How to improve Googlebot's indexing frequency? [closed]

I am experiencing low indexing issues on our website from several months. Google is not indexing the website fast enough. The changes we make take 1 or 2 months to get reflect in search engine. It's a ...
0
votes
0answers
16 views

Google Search Console Coverage Report Too Old

I'm struggling with using the new GSC, primarily my issue is with the Coverage Report being way out of date. I've tried updating and resubmitting the sitemap and various other stuff but with no ...
0
votes
2answers
40 views

Is it a good practice to make login, reset password & register page indexable?

I'm working on an audit for an ecommerce and their login, reset password and register pages are indexable in google. Is it necessary to make them index in google?
1
vote
2answers
401 views

Google references subfolders

Last week I launched a website and created a robots.txt: User-agent: * Disallow: Sitemap: http://mywebsite.tld/sitemap_robots.xml Now I've checked the indexed pages (Google -> site:mywebsite.tld) ...
0
votes
0answers
9 views

How to stop Google from indexing my webpage? [duplicate]

I have a webpage /user/login , I want to keep it private but Google has indexed the page. I have tried lots of ways: In robos.txt, I added a new line:Disallow: /user/, added header header("Robots: ...
28
votes
3answers
4k views

Why aren't search engines indexing my content?

This is a general, community wiki catch-all question and answer pair intended to address any questions concerning the reasons a site or specific site contents do not appear in search engine ...
1
vote
0answers
41 views

Google is trying to index the mail.mydomain.example domain and says this is a coverage issue

I have sub domains for my domains. mail.mydomain.example, ftp.mydomain.example, etc. These sub domains are configured with the DNS server for the domains. Without doing anything on my part Google ...
3
votes
3answers
101 views

Intentional duplicate content. Google indexes the wrong domain

We have a group of websites that are very similar to each other. All the websites are for the same type of business and they all have mostly the same products etc. The websites are supposed to be 90%...
1
vote
0answers
17 views

Make JavaScript Generated content appear on Search Engines, where content differs on a Single Page

I have a PWA hosted on Firebase. On the main URL, like example.com, there's a lot of content that is generated by JavaScript. At the same time, whenever someone accesses example.com/?key=value, where ...
1
vote
0answers
20 views

Will Google be able to index nested loading via AJAX

Pages on many of my websites load additional page content via AJAX calls. The page shell will load quickly for UX reasons. Then the page shell will make secondary AJAX calls to load additional ...
26
votes
6answers
61k views

How to prevent a PDF file from being indexed by search engines?

I have a link to PDF document on a public web-page. How do I prevent search engines from indexing this link and PDF document? The only idea I thought of is to use CAPTCHA. However, I wonder if ...
0
votes
0answers
21 views

Removing old webpages from google index [duplicate]

I have completly remade a website 6 months ago. The pages of the old website still compare in the search results and when they are accessed they return 404. I can't remove these pages from the index. ...
0
votes
0answers
13 views

Git hub repository pages inside the nested folder are not ranking [duplicate]

I have a git hub repository for hackerrank solutions which is ranking very well. Here is the link- https://github.com/Java-aid/Hackerrank-Solutions My repository is ranking well if someone searches ...
2
votes
1answer
52 views

Unexplained URL's on my site

About 6 weeks ago my traffic stats jumped tremendously. I started noticing "top searches" for variations of porn words. In looking at my top landing pages in Google Analytics, it is showing landing ...
0
votes
0answers
19 views

Can I prevent loading some HTML body and head in PWA when javascript is enabled?

We have restricted resource and we can not use server side technology in our website.We are using PWA technology.What is our solution to pages indexed correctly in Google? Can we load some head tags ...
1
vote
1answer
30 views

JavaScript rendered translated versions of pages not indexed separately

My app serves local content from separate subdomains. eg: fr.example.com serves content for french users, www.example.com for global etc. The content on the page is javascript rendered. if I check ...
1
vote
1answer
38 views

Google Indexing a Page I am Working On

I have a few web pages that I am working on. The pages will be ready to be added to a navigation in about a month. Well, Google is already indexing those pages even though they are not ready to be ...
1
vote
0answers
64 views

Google selected canonical overwriting non-duplicate translated pages in another language

Google is ignoring the canonicals & hreflangs for perfectly valid and non-duplicate content Originally the url after language (/de/ or /en/) were the same so I localised those parts as well but ...
0
votes
1answer
108 views

Multiple domains one site indexing issues

I have a site with multiple domains pointed to it as aliases. For example: abc.com (main domain) def.com ghi.com All are pointed to the same server hence whatever on abc.com appears on def.com & ...
3
votes
2answers
2k views

Does rel=“next” have to be in the HEAD?

I'm trying to improve SEO on a platform i'm working with, and was advised to add rel="next" and rel="prev" links to my pages to make it clearer to google which URLS are paginated. My question to you ...