Questions tagged [sitemap]

A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Why google search console does not read sitemap.xml file? [duplicate]

I am getting error "Sitemap could not be read". I have tried every option. Does it mean that I should wait to proceed from google. I have added xml file to public_html. I have tested live ...
0
votes
0answers
14 views

Generate sitemap automatically [closed]

I'm wondering if it's possible to visualize the sitemap of a website. I found this website but that webpage doesn't contain the links to the other webpages like this one. So far I tried xml-sitemaps ...
0
votes
0answers
9 views

Sitemap last modification time vs caching policy, do crawlers search for fresh document?

I have a page with a caching policy (all time the same). But I change the content and update the sitemap with the latest update time. Do crawlers search for fresh content? Not that the caching policy ...
0
votes
2answers
38 views

How to tell search engines that the parent category is more important for ranking?

I am working on an e-commerce website, called Shopless. We have lots of categories, for example the screenshot below show the categories for our job section: The page: shopless.co.nz/jobs is the main ...
1
vote
1answer
26 views

Is the index page more efficient for the robots than sitemap?

Recently, I decided to add an index of subpages (300k), 250 items on each, with pagination. - Could this be more effective than 'sitemap' and can they co-exist together, or it will be bad for the ...
1
vote
1answer
12 views

Should rotating small portions of links in the sitemap help me to index huge number of them?

I recently came across the phrase 'crawling budget'. Is keeping a small number of links in the sitemap and rotating them regularly programmatically more effective than posting everything at once? ...
0
votes
0answers
22 views

How does a search engine discover/crawl a website page when requested URL loads the content via database?

I am creating a new blog website in Django. All the posts and their details are stored inside an SQLite database (one that comes default with Django). Once a post's URL is requested, the server ...
1
vote
1answer
21 views

When the site changes to use `www` does the XML sitemap need to be resubmitted via Google Search Console?

My website's sitemap was previously submitted to Google Search Console without www. Now I asked the domain provider to change my domain URL include www. Do I need to resubmit the website URL in my ...
1
vote
1answer
23 views

How to organise a large sitemap using child sitemaps in each folder

I have a google sitemap which is 1 massive file now because the site has grown large... I want to separate it out so every folder would have its own sitemap instead of 1 giant map in the root folder. ...
0
votes
0answers
16 views

Sitemap and 2 URLs pointing to the same page

I have recently put my site of 17 years with Wix. It is going down fast in Google rankings. My home page in Wix has the slug /home-1 but my site is just example.co.uk/ when I search the home-1 it ...
1
vote
1answer
124 views

Why Google cant see and index my root page from Sitemap?

I will firstly ask a question and below the question you will see an explanation. Can you tell me where is the actual issue in indexing, is my Sitemap correctly set up, and how do I solve this problem ...
2
votes
1answer
42 views

Do I need to submit sitemap.xml to google if I already have it in robots.txt and hosted on S3?

I have a static site hosted on S3 bucket which will have a robots.txt at root directory level. This robots.txt file will have reference to my sitemap.xml file which is hosted on another S3 bucket. It ...
0
votes
1answer
18 views

I have duplicate home page, How Can I fix it?

Using some website audit tools I found that it says a lot that I have a duplicate content like so: https://example.com/ https://example.com/index.php in my sitemap I only have: <url> <loc&...
1
vote
0answers
20 views

Advice for a good sitemap structure

Who can me explain sitemaps? I am interested in the more complexed structure. For example: on the homepage I have hyperlink to a page with categories A category can have a subcategory or a product. ...
0
votes
1answer
35 views

Cache-Control for ads.txt, robots.txt and sitemap.xml files that are generated dynamically

I have some "static files" that I build on the fly, because they are generated dynamically. ads.txt robots.txt sitemap.xml What is the ideal Cache-Control for those files? PS: My server is ...
0
votes
0answers
9 views

what is the difference between “allow: /” and “disallow:” in robots.txt? [duplicate]

I know how robots.txt works but I am confused at one point, the point is what is the difference between these two, I know that they have the same function but which one is more valid than the other, ...
3
votes
1answer
38 views

Change the canonical URL within a product variations group when one goes out of stock?

Ecommerce shop has different pages for different product sizes: /shirt-size-s/ /shirt-size-m/ /shirt-size-xl/ They all point to /shirt-size-s/ as canonical and only this page goes to sitemap.xml ...
2
votes
0answers
22 views

Google Search Console reports error for 'noindex' tag on sitemap

My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error: Submitted URL marked ‘...
1
vote
0answers
39 views

I submitted 500 sitemaps to Google and now it keeps downloading them every 30 minutes nonstop. What is going on?

I used the google.com/ping service to make it download 500 sitemaps for a customer of mine, that was about 30 hours ago. Googlebot reacted immediately, downloaded all 500 sitemaps. Now I have more ...
1
vote
0answers
16 views

Sitemap File for Multiple Languages

Hi Currently my site is in 3 languages:- English, French, Dutch. My main sitemap file is example.com/sitemap.xml I have 2 questions: Since I don't have a root folder for other languages (I only have ...
1
vote
1answer
78 views

Google Search Console reporting only a small fraction of the URLs in my sitemap index have been discovered

My sitemap index file does not show any errors on google search console, but it only shows 397 discovered urls whereas it should have been over a million. Basically my sitemap index file looks like ...
0
votes
0answers
11 views

How can I post a news URL and sitemap to AOL

I have a news website. How can I upload my news post URL and sitemap to AOL?
1
vote
1answer
42 views

Do I need to use “hreflang” when expanding a website to a new country using a different ccTLD domain

I have a website that has really good SEO in Portugal. I use a ccTLD .pt domain, so it's automatically geotargeted for portuguese audience. But now I'm expanding the website to Brazil. And I'll use a ...
2
votes
1answer
41 views

Why can't Google index my site? [closed]

I want Google to index a number of pages on my website, but when I request Google to index the site, it raises an error. How come? Am I doing anything wrong somewhere? The error it's throwing is a ...
1
vote
1answer
16 views

For sitemaps, do I need to urlencode URLs with international characters?

We have urls that will contain international characters... ex: https://example.com/title/oh-wie-schön-ist-panama Do these special characters need to be URL encoded for the our sitemap for the crawlers?...
0
votes
0answers
11 views

Sitemap's lastmod field update for performance related CSS and JS changes

I understand Google mostly ignores lastmod field in sitemaps. However, as a practice, I used to update the tag whenever I make visible changes like content updates. Now, I made significant ...
2
votes
2answers
283 views

Google console indexing request rejected due to FAILED_DOCUMENT_REQUEST

First, let me say that Shopify couldn't figure this out, nor people I tried to hire on Fiverr. My site seemingly, and for no apparent reason, got messed up on Google. My traffic went down to 0 and the ...
0
votes
1answer
117 views

Google not indexing product pages of my website [duplicate]

After many months and many changes to sitemaps/pages trying to solve the problem, Google still is not indexing the product pages of this site (link removed). Here's the sitemap i'm using (link removed)...
1
vote
1answer
34 views

Two sitemaps - one human one bot?

Is there anything "wrong" with having a very simple page in my WordPress site with HTML and text links showing the key pages that I'd like to send my human visitors to? And - in addition, I ...
0
votes
0answers
32 views

Problem with how Google indexes multi-language and multi-domain website

I have a problem with how Google indexes multilanguage/multidomain website. Website itself handles two regions/languages and two domains. Language is identified by url param, not by the domain. ...
2
votes
1answer
156 views

Can I combine sitemap and sitemap index together?

I want to create a sitemap for Google and Bing. Referring to sitemap protocol: https://www.sitemaps.org/protocol.html#sitemapXMLExample I want to combine sitemap file and sitemap-index file in one. ...
2
votes
1answer
98 views

What is difference between robots.txt, sitemap, robots meta tag, robots header tag?

So I am trying to learn SEO and I am honestly confused and have following 8 questions. Do I tell a bot not to visit a certain link through X-Robots-Tag or through robot meta tag or robots.txt? Is it ...
0
votes
1answer
51 views

Maintaining 1 sitemap.xml in two subdomains

Im trying to include an auto-generated sitemap.xml file whenever we build our frontend application. Unfortunately due to legacy reasons, we use the same frontend build script on our production and ...
1
vote
2answers
31 views

Notify search engines on 404 pages

How to pro-actively notify search engines (Google and others) of removed pages 404s that are still indexed?
0
votes
1answer
148 views

Is it okay to host sitemap.xml outside the domain root?

Let's say I have a website www.example.com. Is it okay to host the sitemap.xml outside www.example.com such as https://example.cloudstorage.com/static/sitemap.xml? All the entries in the sitemap ...
0
votes
1answer
141 views

Nested reference of URL'S in sitemap.xml good or bad for SEO?

I am having thousands of URL's in the website, If I put all URL's in sitemap.xml it's getting too large in size. There is some suggestion to split those URLs into different files and referring in main ...
2
votes
1answer
33 views

Optimize lastmod fields in sitemap index files for a large website that are expensive to compute

I am trying to create sitemaps for a very large multilingual website; means that every single URL is duplicated with as many languages there are; however the more pressing issue is that content is ...
0
votes
0answers
8 views

XML Sitemap submitted but few page show indexed via Google site: search [duplicate]

I submitted a sitemap of my website to Google. (japan1900.com) The sitemap : (https://japan1900.com/en/module/lgsitemaps/sitemap?fc=module&name=product_1_1) The robots.txt : https://japan1900.com/...
0
votes
0answers
12 views

How to target different countries using same URL? [duplicate]

We are based in India Digital Marketing company , we want to target us, uk, middle east countries with the same website, language is English. How to tell to robots this from sitemap?
0
votes
0answers
11 views

Does Google index your sitemap? [duplicate]

I have submitted a sitemap for my domain but I have a concern. I don't want my sitemap to appear in Google Search results, I only want Google to use my sitemap to index my actual site through the ...
1
vote
0answers
66 views

Google Search Console cannot read my XML: Sitemap appears to be an HTML page

I'm working on a web application written with AngularJS (v8) and deployed on an apache2 using proxy to forward requests (frontend, api, backoffice). My problem is that I'm trying to submit the ...
1
vote
1answer
129 views

Sitemap: Should I dynamically update sitemap for dynamic content or create a page containing all the dynamic links

Say i have the following route http://<my-domain>/{category}/subjects/{id}/{title} the ones in the brackets are dynamic, I'm struggling with what is better or any better way to let google crawl ...
0
votes
0answers
162 views

Sitemap for one website in multiple domains

I have 2 domains (A and B). The first one (A) is the website. In sitemap.xml of "A" domain, I have a sub-sitemap in "B" domain with "A" URLs. A/sitemap.xml : <...
1
vote
0answers
71 views

What URL am I supposed to use in <video:player_loc> for my sitemap when adding a YouTube video?

I'm somewhat confused. I'm following this example on how to create video sitemap. So say, I need to add the <video:video> tag to my page's sitemap that contains this YouTube video: https://www....
0
votes
0answers
6 views

URL is not on Google [duplicate]

URL is not on Google This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed. Learn more Coverage Discovery Sitemaps N/A Referring page None ...
0
votes
1answer
30 views

Google crawlbot parses &amp; on sitemap.xml wrong

I have a sitemap.xml file with entries of the form: <url> <loc>https://www.example.com/?page=x&amp;item=5</loc> <changefreq>weekly</changefreq> </url> ...
0
votes
1answer
84 views

Should I include a trailing slash for my <xhtml:link rel=“alternate” href=“URL” hreflang=“en-US”/> URLs?

I'm implementing hreflang on my web app. Google does not mention anything on https://support.google.com/webmasters/answer/189077?hl=en But they use it (trailing slashes) on their own Sitemap. https:...
2
votes
1answer
26 views

Handling “rel hreflang” for specific languages in countries “en-US” and generic languages ex: “en”

If I have 3 english versions of my website: / FOR USA /au FOR AUSTRALIA /gb FOR United Kingdom I would add them to my Sitemap using rel hreflang to serve those 3 countries: Sitemap....
1
vote
0answers
11 views

Handling international SEO indexing for “country-specific” and “language-specific” URLs on the same website?

I'm developing an international website and this is my current situation. My home URL is country-specific, i.e: every country has specific content that differs from the others. / USA /au ...
2
votes
0answers
20 views

Google Search Console not finding all Sitemaps within Sitemap Index. How to fix? [duplicate]

I created a valid Sitemap Index (/sitemap-dec2019/sitemap_index.xml) for a site as follows: <?xml version="1.0" encoding="UTF-8"?> <sitemapindex xmlns="http://www.sitemaps.org/schemas/...

1
2 3 4 5
15