Questions tagged [sitemap]
A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
759
questions
0
votes
0answers
23 views
MediaWiki sitemap creation tool not working [closed]
I have a MediaWiki 1.36.1 website hosted with NameCheap's shared Stellar business plan.
The website has about 1,500 webpages and I am having trouble creating a sitemap for it with the MediaWiki tool, ...
6
votes
3answers
225 views
Shall I submit sitemap containing all the bad (now 404) urls after the spam url hack?
Earlier this month, one of my sites got hacked and an attacker created near 1 million spam URLs. The site has been fixed relatively fast, however, after one month Google SERP still shows near 500000 ...
2
votes
2answers
164 views
What generates the preview data for Google search engine?
Well when I search our website through Google site:allsports.app. I notice first that it correctly limited itself to what is (was) defined in the sitemap. I also notice that for most pages it does not ...
2
votes
1answer
40 views
Google Search Console and sitemap-index file gzip
I googled for a long time and tried to find something at https://www.sitemaps.org/protocol.html#index about gzip compression for sitemap INDEX files, but I couldn't find anything.
I have a very large ...
0
votes
1answer
44 views
Sitemap urlset http or https [duplicate]
I am a Static User I write my all pages and sitemap with pure html css code, I have a question that in sitemap I am using http xmlns in order to make my sitemaps so is it allowed to add https or http ...
1
vote
0answers
24 views
Do I need to submit separate sitemaps for language based subdirectories?
my company uses a site that targets the different regions we are based in using subdirectories (www.example.com/en-sg/) instead of subdomains (www.en-sg.example.com). Can I ask if I will need to ...
1
vote
1answer
21 views
Should I add links to the Sitemap that are disallowed in robots.txt?
My robots.txt contains the line Disallow: /search.php.
Shall I nevertheless include http://example.com/search.php into my sitemap?
1
vote
0answers
19 views
Updated sitemap not read automatically by Google
Google is not reading my sitemap of my wordpress site automatically. The 'last date read' remains the same as the submitted date. I had updated the contents of my site a couple of weeks ago, and the ...
1
vote
0answers
14 views
sitemap submission error [closed]
I am facing the issue of a sitemap error in the google search console. I have submitted the sitemap manually in the search console and submission was successful but further, it is not discovering URLs ...
3
votes
1answer
59 views
How should I choose which URLs I want indexed to include in my sitemap?
I am working on a sitemap. I have read it should contain the URLs that you want indexed by Google. But which pages do I want indexed?
It seems to me that makes sense to index pages such as the root ...
2
votes
1answer
25 views
Which pages get their own canonical URLs?
I am currently working to improve my site's SEO and I need to use canonical URLs. My doubt is related to which pages need to be canonical.
I know for sure that my root home page needs its own ...
2
votes
1answer
17 views
Should the same hreflang localization links be repeated under the <loc> for different languages in an XML sitemap?
So I know that alternative links should be put like the below in a sitemap...
<url>
<loc>http://www.mywebsite.com/lang/french/</loc>
<xhtml:link
rel="alternate&...
0
votes
1answer
86 views
Nextjs Sitemap not fetch by Google search console
I created a small web application with Next.js and it works fine. Now I need to index that on google. It has dynamic pages too. So I created a dynamic sitemap using Sitemap npm module. But when I ...
2
votes
1answer
53 views
Sitemap does not get rendered correctly and has errors
I recently did some changes to my sitemap because i updated my website to support two languages but now i get an error when submitting the sitemap and i don't see where the problem is.
Your Sitemap ...
1
vote
1answer
63 views
Nextjs slugs are indexed in search console
I'm building a webapp using Nextjs. As some parts of the app is server side rendering, I have two sitemaps. One generated by Next and the other one generated dynamically.
All pages are successfully ...
2
votes
2answers
44 views
What to do when you have sitemap.xml AND canonical url?
On a project, there is two different URL, that has a lot of the same content. As an example, let's say:
https://first-url.example/text/my-post
https://second-url.example/text/my-post
The https://...
0
votes
0answers
11 views
Github blog not indexed by Google [duplicate]
I created a blog via Github Pages and as I started writing articles I wanted to check if it was indexed by Google. The blog is:
https://pablolec.github.io/
After a few weeks I manually added it to ...
0
votes
0answers
18 views
Why google search console does not read sitemap.xml file? [duplicate]
I am getting error "Sitemap could not be read". I have tried every option. Does it mean that I should wait to proceed from google. I have added xml file to public_html. I have tested live ...
0
votes
0answers
11 views
Sitemap last modification time vs caching policy, do crawlers search for fresh document?
I have a page with a caching policy (all time the same). But I change the content and update the sitemap with the latest update time. Do crawlers search for fresh content?
Not that the caching policy ...
0
votes
2answers
43 views
How to tell search engines that the parent category is more important for ranking?
I am working on an e-commerce website, called Shopless. We have lots of categories, for example the screenshot below show the categories for our job section:
The page: shopless.co.nz/jobs is the main ...
1
vote
1answer
31 views
Is the index page more efficient for the robots than sitemap?
Recently, I decided to add an index of subpages (300k), 250 items on each, with pagination.
- Could this be more effective than 'sitemap' and can they co-exist together, or it will be bad for the ...
1
vote
1answer
15 views
Should rotating small portions of links in the sitemap help me to index huge number of them?
I recently came across the phrase 'crawling budget'.
Is keeping a small number of links in the sitemap and rotating them regularly programmatically more effective than posting everything at once? ...
0
votes
0answers
23 views
How does a search engine discover/crawl a website page when requested URL loads the content via database?
I am creating a new blog website in Django. All the posts and their details are stored inside an SQLite database (one that comes default with Django). Once a post's URL is requested, the server ...
1
vote
1answer
23 views
When the site changes to use `www` does the XML sitemap need to be resubmitted via Google Search Console?
My website's sitemap was previously submitted to Google Search Console without www. Now I asked the domain provider to change my domain URL include www. Do I need to resubmit the website URL in my ...
1
vote
1answer
26 views
How to organise a large sitemap using child sitemaps in each folder
I have a google sitemap which is 1 massive file now because the site has grown large... I want to separate it out so every folder would have its own sitemap instead of 1 giant map in the root folder. ...
0
votes
0answers
18 views
Sitemap and 2 URLs pointing to the same page
I have recently put my site of 17 years with Wix. It is going down fast in Google rankings.
My home page in Wix has the slug /home-1 but my site is just example.co.uk/ when I search the home-1 it ...
1
vote
1answer
129 views
Why Google cant see and index my root page from Sitemap?
I will firstly ask a question and below the question you will see an explanation.
Can you tell me where is the actual issue in indexing, is my Sitemap correctly set up, and how do I solve this problem ...
2
votes
1answer
65 views
Do I need to submit sitemap.xml to google if I already have it in robots.txt and hosted on S3?
I have a static site hosted on S3 bucket which will have a robots.txt at root directory level.
This robots.txt file will have reference to my sitemap.xml file which is hosted on another S3 bucket. It ...
0
votes
1answer
21 views
I have duplicate home page, How Can I fix it?
Using some website audit tools I found that it says a lot that I have a duplicate content like so:
https://example.com/
https://example.com/index.php
in my sitemap I only have:
<url>
<loc&...
1
vote
0answers
21 views
Advice for a good sitemap structure
Who can me explain sitemaps? I am interested in the more complexed structure.
For example: on the homepage I have hyperlink to a page with categories A category can have a subcategory or a product.
...
1
vote
1answer
92 views
Cache-Control for ads.txt, robots.txt and sitemap.xml files that are generated dynamically
I have some "static files" that I build on the fly, because they are generated dynamically.
ads.txt
robots.txt
sitemap.xml
What is the ideal Cache-Control for those files? PS: My server is ...
0
votes
0answers
10 views
what is the difference between "allow: /" and "disallow:" in robots.txt? [duplicate]
I know how robots.txt works but I am confused at one point, the point is what is the difference between these two, I know that they have the same function but which one is more valid than the other, ...
3
votes
1answer
45 views
Change the canonical URL within a product variations group when one goes out of stock?
Ecommerce shop has different pages for different product sizes:
/shirt-size-s/
/shirt-size-m/
/shirt-size-xl/
They all point to /shirt-size-s/ as canonical and only this page goes to sitemap.xml
...
2
votes
0answers
26 views
Google Search Console reports error for 'noindex' tag on sitemap
My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error:
Submitted URL marked ‘...
1
vote
0answers
41 views
I submitted 500 sitemaps to Google and now it keeps downloading them every 30 minutes nonstop. What is going on?
I used the google.com/ping service to make it download 500 sitemaps for a customer of mine, that was about 30 hours ago.
Googlebot reacted immediately, downloaded all 500 sitemaps.
Now I have more ...
1
vote
0answers
26 views
Sitemap File for Multiple Languages
Hi Currently my site is in 3 languages:- English, French, Dutch.
My main sitemap file is example.com/sitemap.xml
I have 2 questions:
Since I don't have a root folder for other languages (I only have ...
1
vote
1answer
98 views
Google Search Console reporting only a small fraction of the URLs in my sitemap index have been discovered
My sitemap index file does not show any errors on google search console, but it only shows 397 discovered urls whereas it should have been over a million.
Basically my sitemap index file looks like ...
0
votes
0answers
16 views
How can I post a news URL and sitemap to AOL
I have a news website. How can I upload my news post URL and sitemap to AOL?
1
vote
1answer
57 views
Do I need to use "hreflang" when expanding a website to a new country using a different ccTLD domain
I have a website that has really good SEO in Portugal.
I use a ccTLD .pt domain, so it's automatically geotargeted for portuguese audience.
But now I'm expanding the website to Brazil. And I'll use a ...
2
votes
1answer
43 views
Why can't Google index my site? [closed]
I want Google to index a number of pages on my website, but when I request Google to index the site, it raises an error. How come?
Am I doing anything wrong somewhere?
The error it's throwing is a ...
1
vote
1answer
18 views
For sitemaps, do I need to urlencode URLs with international characters?
We have urls that will contain international characters...
ex: https://example.com/title/oh-wie-schön-ist-panama
Do these special characters need to be URL encoded for the our sitemap for the crawlers?...
0
votes
0answers
12 views
Sitemap's lastmod field update for performance related CSS and JS changes
I understand Google mostly ignores lastmod field in sitemaps. However, as a practice, I used to update the tag whenever I make visible changes like content updates. Now, I made significant ...
2
votes
2answers
561 views
Google console indexing request rejected due to FAILED_DOCUMENT_REQUEST
First, let me say that Shopify couldn't figure this out, nor people I tried to hire on Fiverr.
My site seemingly, and for no apparent reason, got messed up on Google.
My traffic went down to 0 and the ...
0
votes
1answer
166 views
Google not indexing product pages of my website [duplicate]
After many months and many changes to sitemaps/pages trying to solve the problem, Google still is not indexing the product pages of this site (link removed).
Here's the sitemap i'm using (link removed)...
1
vote
1answer
36 views
Two sitemaps - one human one bot?
Is there anything "wrong" with having a very simple page in my WordPress site with HTML and text links showing the key pages that I'd like to send my human visitors to?
And - in addition, I ...
0
votes
0answers
36 views
Problem with how Google indexes multi-language and multi-domain website
I have a problem with how Google indexes multilanguage/multidomain website.
Website itself handles two regions/languages and two domains. Language is identified by url param, not by the domain. ...
3
votes
1answer
216 views
Can I combine sitemap and sitemap index together?
I want to create a sitemap for Google and Bing.
Referring to sitemap protocol: https://www.sitemaps.org/protocol.html#sitemapXMLExample
I want to combine sitemap file and sitemap-index file in one. ...
2
votes
1answer
144 views
What is difference between robots.txt, sitemap, robots meta tag, robots header tag?
So I am trying to learn SEO and I am honestly confused and have following 8 questions.
Do I tell a bot not to visit a certain link through X-Robots-Tag or through robot meta tag or robots.txt?
Is it ...
0
votes
1answer
61 views
Maintaining 1 sitemap.xml in two subdomains
Im trying to include an auto-generated sitemap.xml file whenever we build our frontend application.
Unfortunately due to legacy reasons, we use the same frontend build script on our production and ...
1
vote
2answers
33 views
Notify search engines on 404 pages
How to pro-actively notify search engines (Google and others) of removed pages 404s that are still indexed?
