Questions tagged [sitemap]
A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
752
questions
0
votes
0answers
7 views
Updated sitemap not read automatically by Google
Google is not reading my sitemap of my wordpress site automatically. The 'last date read' remains the same as the submitted date. I had updated the contents of my site a couple of weeks ago, and the ...
1
vote
0answers
13 views
sitemap submission error [closed]
I am facing the issue of a sitemap error in the google search console. I have submitted the sitemap manually in the search console and submission was successful but further, it is not discovering URLs ...
1
vote
1answer
15 views
How should I choose which URLs I want indexed to include in my sitemap?
I am working on a sitemap. I have read it should contain the URLs that you want indexed by Google. But which pages do I want indexed?
It seems to me that makes sense to index pages such as the root ...
2
votes
1answer
24 views
Which pages get their own canonical URLs?
I am currently working to improve my site's SEO and I need to use canonical URLs. My doubt is related to which pages need to be canonical.
I know for sure that my root home page needs its own ...
1
vote
1answer
14 views
Should the same hreflang localization links be repeated under the <loc> for different languages in an XML sitemap?
So I know that alternative links should be put like the below in a sitemap...
<url>
<loc>http://www.mywebsite.com/lang/french/</loc>
<xhtml:link
rel="alternate&...
0
votes
1answer
36 views
Nextjs Sitemap not fetch by Google search console
I created a small web application with Next.js and it works fine. Now I need to index that on google. It has dynamic pages too. So I created a dynamic sitemap using Sitemap npm module. But when I ...
2
votes
1answer
30 views
Sitemap can be read, but has errors
I recently did some changes to my sitemap because i updated my website to support two languages but now i get an error when submitting the sitemap and i don't see where the problem is.
Your Sitemap ...
1
vote
1answer
35 views
Nextjs slugs are indexed in search console
I'm building a webapp using Nextjs. As some parts of the app is server side rendering, I have two sitemaps. One generated by Next and the other one generated dynamically.
All pages are successfully ...
2
votes
2answers
36 views
What to do when you have sitemap.xml AND canonical url?
On a project, there is two different URL, that has a lot of the same content. As an example, let's say:
https://first-url.example/text/my-post
https://second-url.example/text/my-post
The https://...
0
votes
0answers
11 views
Github blog not indexed by Google [duplicate]
I created a blog via Github Pages and as I started writing articles I wanted to check if it was indexed by Google. The blog is:
https://pablolec.github.io/
After a few weeks I manually added it to ...
0
votes
0answers
15 views
Why google search console does not read sitemap.xml file? [duplicate]
I am getting error "Sitemap could not be read". I have tried every option. Does it mean that I should wait to proceed from google. I have added xml file to public_html. I have tested live ...
0
votes
0answers
10 views
Sitemap last modification time vs caching policy, do crawlers search for fresh document?
I have a page with a caching policy (all time the same). But I change the content and update the sitemap with the latest update time. Do crawlers search for fresh content?
Not that the caching policy ...
0
votes
2answers
41 views
How to tell search engines that the parent category is more important for ranking?
I am working on an e-commerce website, called Shopless. We have lots of categories, for example the screenshot below show the categories for our job section:
The page: shopless.co.nz/jobs is the main ...
1
vote
1answer
30 views
Is the index page more efficient for the robots than sitemap?
Recently, I decided to add an index of subpages (300k), 250 items on each, with pagination.
- Could this be more effective than 'sitemap' and can they co-exist together, or it will be bad for the ...
1
vote
1answer
13 views
Should rotating small portions of links in the sitemap help me to index huge number of them?
I recently came across the phrase 'crawling budget'.
Is keeping a small number of links in the sitemap and rotating them regularly programmatically more effective than posting everything at once? ...
0
votes
0answers
22 views
How does a search engine discover/crawl a website page when requested URL loads the content via database?
I am creating a new blog website in Django. All the posts and their details are stored inside an SQLite database (one that comes default with Django). Once a post's URL is requested, the server ...
1
vote
1answer
22 views
When the site changes to use `www` does the XML sitemap need to be resubmitted via Google Search Console?
My website's sitemap was previously submitted to Google Search Console without www. Now I asked the domain provider to change my domain URL include www. Do I need to resubmit the website URL in my ...
1
vote
1answer
24 views
How to organise a large sitemap using child sitemaps in each folder
I have a google sitemap which is 1 massive file now because the site has grown large... I want to separate it out so every folder would have its own sitemap instead of 1 giant map in the root folder. ...
0
votes
0answers
17 views
Sitemap and 2 URLs pointing to the same page
I have recently put my site of 17 years with Wix. It is going down fast in Google rankings.
My home page in Wix has the slug /home-1 but my site is just example.co.uk/ when I search the home-1 it ...
1
vote
1answer
128 views
Why Google cant see and index my root page from Sitemap?
I will firstly ask a question and below the question you will see an explanation.
Can you tell me where is the actual issue in indexing, is my Sitemap correctly set up, and how do I solve this problem ...
2
votes
1answer
56 views
Do I need to submit sitemap.xml to google if I already have it in robots.txt and hosted on S3?
I have a static site hosted on S3 bucket which will have a robots.txt at root directory level.
This robots.txt file will have reference to my sitemap.xml file which is hosted on another S3 bucket. It ...
0
votes
1answer
20 views
I have duplicate home page, How Can I fix it?
Using some website audit tools I found that it says a lot that I have a duplicate content like so:
https://example.com/
https://example.com/index.php
in my sitemap I only have:
<url>
<loc&...
1
vote
0answers
20 views
Advice for a good sitemap structure
Who can me explain sitemaps? I am interested in the more complexed structure.
For example: on the homepage I have hyperlink to a page with categories A category can have a subcategory or a product.
...
0
votes
1answer
68 views
Cache-Control for ads.txt, robots.txt and sitemap.xml files that are generated dynamically
I have some "static files" that I build on the fly, because they are generated dynamically.
ads.txt
robots.txt
sitemap.xml
What is the ideal Cache-Control for those files? PS: My server is ...
0
votes
0answers
10 views
what is the difference between “allow: /” and “disallow:” in robots.txt? [duplicate]
I know how robots.txt works but I am confused at one point, the point is what is the difference between these two, I know that they have the same function but which one is more valid than the other, ...
3
votes
1answer
42 views
Change the canonical URL within a product variations group when one goes out of stock?
Ecommerce shop has different pages for different product sizes:
/shirt-size-s/
/shirt-size-m/
/shirt-size-xl/
They all point to /shirt-size-s/ as canonical and only this page goes to sitemap.xml
...
2
votes
0answers
23 views
Google Search Console reports error for 'noindex' tag on sitemap
My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error:
Submitted URL marked ‘...
1
vote
0answers
40 views
I submitted 500 sitemaps to Google and now it keeps downloading them every 30 minutes nonstop. What is going on?
I used the google.com/ping service to make it download 500 sitemaps for a customer of mine, that was about 30 hours ago.
Googlebot reacted immediately, downloaded all 500 sitemaps.
Now I have more ...
1
vote
0answers
20 views
Sitemap File for Multiple Languages
Hi Currently my site is in 3 languages:- English, French, Dutch.
My main sitemap file is example.com/sitemap.xml
I have 2 questions:
Since I don't have a root folder for other languages (I only have ...
1
vote
1answer
91 views
Google Search Console reporting only a small fraction of the URLs in my sitemap index have been discovered
My sitemap index file does not show any errors on google search console, but it only shows 397 discovered urls whereas it should have been over a million.
Basically my sitemap index file looks like ...
0
votes
0answers
12 views
How can I post a news URL and sitemap to AOL
I have a news website. How can I upload my news post URL and sitemap to AOL?
1
vote
1answer
53 views
Do I need to use “hreflang” when expanding a website to a new country using a different ccTLD domain
I have a website that has really good SEO in Portugal.
I use a ccTLD .pt domain, so it's automatically geotargeted for portuguese audience.
But now I'm expanding the website to Brazil. And I'll use a ...
2
votes
1answer
42 views
Why can't Google index my site? [closed]
I want Google to index a number of pages on my website, but when I request Google to index the site, it raises an error. How come?
Am I doing anything wrong somewhere?
The error it's throwing is a ...
1
vote
1answer
17 views
For sitemaps, do I need to urlencode URLs with international characters?
We have urls that will contain international characters...
ex: https://example.com/title/oh-wie-schön-ist-panama
Do these special characters need to be URL encoded for the our sitemap for the crawlers?...
0
votes
0answers
11 views
Sitemap's lastmod field update for performance related CSS and JS changes
I understand Google mostly ignores lastmod field in sitemaps. However, as a practice, I used to update the tag whenever I make visible changes like content updates. Now, I made significant ...
2
votes
2answers
418 views
Google console indexing request rejected due to FAILED_DOCUMENT_REQUEST
First, let me say that Shopify couldn't figure this out, nor people I tried to hire on Fiverr.
My site seemingly, and for no apparent reason, got messed up on Google.
My traffic went down to 0 and the ...
0
votes
1answer
155 views
Google not indexing product pages of my website [duplicate]
After many months and many changes to sitemaps/pages trying to solve the problem, Google still is not indexing the product pages of this site (link removed).
Here's the sitemap i'm using (link removed)...
1
vote
1answer
34 views
Two sitemaps - one human one bot?
Is there anything "wrong" with having a very simple page in my WordPress site with HTML and text links showing the key pages that I'd like to send my human visitors to?
And - in addition, I ...
0
votes
0answers
35 views
Problem with how Google indexes multi-language and multi-domain website
I have a problem with how Google indexes multilanguage/multidomain website.
Website itself handles two regions/languages and two domains. Language is identified by url param, not by the domain. ...
2
votes
1answer
186 views
Can I combine sitemap and sitemap index together?
I want to create a sitemap for Google and Bing.
Referring to sitemap protocol: https://www.sitemaps.org/protocol.html#sitemapXMLExample
I want to combine sitemap file and sitemap-index file in one. ...
2
votes
1answer
124 views
What is difference between robots.txt, sitemap, robots meta tag, robots header tag?
So I am trying to learn SEO and I am honestly confused and have following 8 questions.
Do I tell a bot not to visit a certain link through X-Robots-Tag or through robot meta tag or robots.txt?
Is it ...
0
votes
1answer
55 views
Maintaining 1 sitemap.xml in two subdomains
Im trying to include an auto-generated sitemap.xml file whenever we build our frontend application.
Unfortunately due to legacy reasons, we use the same frontend build script on our production and ...
1
vote
2answers
31 views
Notify search engines on 404 pages
How to pro-actively notify search engines (Google and others) of removed pages 404s that are still indexed?
0
votes
1answer
194 views
Is it okay to host sitemap.xml outside the domain root?
Let's say I have a website www.example.com. Is it okay to host the sitemap.xml outside www.example.com such as https://example.cloudstorage.com/static/sitemap.xml? All the entries in the sitemap ...
0
votes
1answer
158 views
Nested reference of URL'S in sitemap.xml good or bad for SEO?
I am having thousands of URL's in the website, If I put all URL's in sitemap.xml it's getting too large in size. There is some suggestion to split those URLs into different files and referring in main ...
2
votes
1answer
45 views
Optimize lastmod fields in sitemap index files for a large website that are expensive to compute
I am trying to create sitemaps for a very large multilingual website; means that every single URL is duplicated with as many languages there are; however the more pressing issue is that content is ...
0
votes
0answers
8 views
XML Sitemap submitted but few page show indexed via Google site: search [duplicate]
I submitted a sitemap of my website to Google. (japan1900.com)
The sitemap : (https://japan1900.com/en/module/lgsitemaps/sitemap?fc=module&name=product_1_1)
The robots.txt : https://japan1900.com/...
1
vote
0answers
66 views
Google Search Console cannot read my XML: Sitemap appears to be an HTML page
I'm working on a web application written with AngularJS (v8) and deployed on an apache2 using proxy to forward requests (frontend, api, backoffice).
My problem is that I'm trying to submit the ...
1
vote
1answer
181 views
Sitemap: Should I dynamically update sitemap for dynamic content or create a page containing all the dynamic links
Say i have the following route http://<my-domain>/{category}/subjects/{id}/{title}
the ones in the brackets are dynamic, I'm struggling with what is better or any better way to let google crawl ...
0
votes
0answers
214 views
Sitemap for one website in multiple domains
I have 2 domains (A and B). The first one (A) is the website.
In sitemap.xml of "A" domain, I have a sub-sitemap in "B" domain with "A" URLs.
A/sitemap.xml :
<...
