Questions tagged [sitemap]
A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
745
questions
0
votes
0answers
14 views
Generate sitemap automatically [closed]
I'm wondering if it's possible to visualize the sitemap of a website. I found this website but that webpage doesn't contain the links to the other webpages like this one.
So far I tried xml-sitemaps ...
0
votes
0answers
8 views
Sitemap last modification time vs caching policy, do crawlers search for fresh document?
I have a page with a caching policy (all time the same). But I change the content and update the sitemap with the latest update time. Do crawlers search for fresh content?
Not that the caching policy ...
0
votes
2answers
37 views
How to tell search engines that the parent category is more important for ranking?
I am working on an e-commerce website, called Shopless. We have lots of categories, for example the screenshot below show the categories for our job section:
The page: shopless.co.nz/jobs is the main ...
1
vote
1answer
26 views
Is the index page more efficient for the robots than sitemap?
Recently, I decided to add an index of subpages (300k), 250 items on each, with pagination.
- Could this be more effective than 'sitemap' and can they co-exist together, or it will be bad for the ...
1
vote
1answer
12 views
Should rotating small portions of links in the sitemap help me to index huge number of them?
I recently came across the phrase 'crawling budget'.
Is keeping a small number of links in the sitemap and rotating them regularly programmatically more effective than posting everything at once? ...
0
votes
0answers
21 views
How does a search engine discover/crawl a website page when requested URL loads the content via database?
I am creating a new blog website in Django. All the posts and their details are stored inside an SQLite database (one that comes default with Django). Once a post's URL is requested, the server ...
1
vote
1answer
21 views
When the site changes to use `www` does the XML sitemap need to be resubmitted via Google Search Console?
My website's sitemap was previously submitted to Google Search Console without www. Now I asked the domain provider to change my domain URL include www. Do I need to resubmit the website URL in my ...
1
vote
1answer
23 views
How to organise a large sitemap using child sitemaps in each folder
I have a google sitemap which is 1 massive file now because the site has grown large... I want to separate it out so every folder would have its own sitemap instead of 1 giant map in the root folder. ...
0
votes
0answers
16 views
Sitemap and 2 URLs pointing to the same page
I have recently put my site of 17 years with Wix. It is going down fast in Google rankings.
My home page in Wix has the slug /home-1 but my site is just example.co.uk/ when I search the home-1 it ...
1
vote
1answer
124 views
Why Google cant see and index my root page from Sitemap?
I will firstly ask a question and below the question you will see an explanation.
Can you tell me where is the actual issue in indexing, is my Sitemap correctly set up, and how do I solve this problem ...
2
votes
1answer
42 views
Do I need to submit sitemap.xml to google if I already have it in robots.txt and hosted on S3?
I have a static site hosted on S3 bucket which will have a robots.txt at root directory level.
This robots.txt file will have reference to my sitemap.xml file which is hosted on another S3 bucket. It ...
0
votes
1answer
18 views
I have duplicate home page, How Can I fix it?
Using some website audit tools I found that it says a lot that I have a duplicate content like so:
https://example.com/
https://example.com/index.php
in my sitemap I only have:
<url>
<loc&...
1
vote
0answers
20 views
Advice for a good sitemap structure
Who can me explain sitemaps? I am interested in the more complexed structure.
For example: on the homepage I have hyperlink to a page with categories A category can have a subcategory or a product.
...
0
votes
1answer
33 views
Cache-Control for ads.txt, robots.txt and sitemap.xml files that are generated dynamically
I have some "static files" that I build on the fly, because they are generated dynamically.
ads.txt
robots.txt
sitemap.xml
What is the ideal Cache-Control for those files? PS: My server is ...
0
votes
0answers
9 views
what is the difference between “allow: /” and “disallow:” in robots.txt? [duplicate]
I know how robots.txt works but I am confused at one point, the point is what is the difference between these two, I know that they have the same function but which one is more valid than the other, ...
3
votes
1answer
38 views
Change the canonical URL within a product variations group when one goes out of stock?
Ecommerce shop has different pages for different product sizes:
/shirt-size-s/
/shirt-size-m/
/shirt-size-xl/
They all point to /shirt-size-s/ as canonical and only this page goes to sitemap.xml
...
2
votes
0answers
22 views
Google Search Console reports error for 'noindex' tag on sitemap
My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error:
Submitted URL marked ‘...
1
vote
0answers
39 views
I submitted 500 sitemaps to Google and now it keeps downloading them every 30 minutes nonstop. What is going on?
I used the google.com/ping service to make it download 500 sitemaps for a customer of mine, that was about 30 hours ago.
Googlebot reacted immediately, downloaded all 500 sitemaps.
Now I have more ...
1
vote
0answers
15 views
Sitemap File for Multiple Languages
Hi Currently my site is in 3 languages:- English, French, Dutch.
My main sitemap file is example.com/sitemap.xml
I have 2 questions:
Since I don't have a root folder for other languages (I only have ...
1
vote
1answer
77 views
Google Search Console reporting only a small fraction of the URLs in my sitemap index have been discovered
My sitemap index file does not show any errors on google search console, but it only shows 397 discovered urls whereas it should have been over a million.
Basically my sitemap index file looks like ...
0
votes
0answers
11 views
How can I post a news URL and sitemap to AOL
I have a news website. How can I upload my news post URL and sitemap to AOL?
1
vote
1answer
42 views
Do I need to use “hreflang” when expanding a website to a new country using a different ccTLD domain
I have a website that has really good SEO in Portugal.
I use a ccTLD .pt domain, so it's automatically geotargeted for portuguese audience.
But now I'm expanding the website to Brazil. And I'll use a ...
2
votes
1answer
41 views
Why can't Google index my site? [closed]
I want Google to index a number of pages on my website, but when I request Google to index the site, it raises an error. How come?
Am I doing anything wrong somewhere?
The error it's throwing is a ...
1
vote
1answer
16 views
For sitemaps, do I need to urlencode URLs with international characters?
We have urls that will contain international characters...
ex: https://example.com/title/oh-wie-schön-ist-panama
Do these special characters need to be URL encoded for the our sitemap for the crawlers?...
0
votes
0answers
11 views
Sitemap's lastmod field update for performance related CSS and JS changes
I understand Google mostly ignores lastmod field in sitemaps. However, as a practice, I used to update the tag whenever I make visible changes like content updates. Now, I made significant ...
2
votes
2answers
277 views
Google console indexing request rejected due to FAILED_DOCUMENT_REQUEST
First, let me say that Shopify couldn't figure this out, nor people I tried to hire on Fiverr.
My site seemingly, and for no apparent reason, got messed up on Google.
My traffic went down to 0 and the ...
0
votes
1answer
113 views
Google not indexing product pages of my website [duplicate]
After many months and many changes to sitemaps/pages trying to solve the problem, Google still is not indexing the product pages of this site (link removed).
Here's the sitemap i'm using (link removed)...
1
vote
1answer
34 views
Two sitemaps - one human one bot?
Is there anything "wrong" with having a very simple page in my WordPress site with HTML and text links showing the key pages that I'd like to send my human visitors to?
And - in addition, I ...
0
votes
0answers
32 views
Problem with how Google indexes multi-language and multi-domain website
I have a problem with how Google indexes multilanguage/multidomain website.
Website itself handles two regions/languages and two domains. Language is identified by url param, not by the domain. ...
2
votes
1answer
153 views
Can I combine sitemap and sitemap index together?
I want to create a sitemap for Google and Bing.
Referring to sitemap protocol: https://www.sitemaps.org/protocol.html#sitemapXMLExample
I want to combine sitemap file and sitemap-index file in one. ...
2
votes
1answer
95 views
What is difference between robots.txt, sitemap, robots meta tag, robots header tag?
So I am trying to learn SEO and I am honestly confused and have following 8 questions.
Do I tell a bot not to visit a certain link through X-Robots-Tag or through robot meta tag or robots.txt?
Is it ...
0
votes
1answer
51 views
Maintaining 1 sitemap.xml in two subdomains
Im trying to include an auto-generated sitemap.xml file whenever we build our frontend application.
Unfortunately due to legacy reasons, we use the same frontend build script on our production and ...
1
vote
2answers
31 views
Notify search engines on 404 pages
How to pro-actively notify search engines (Google and others) of removed pages 404s that are still indexed?
0
votes
1answer
144 views
Is it okay to host sitemap.xml outside the domain root?
Let's say I have a website www.example.com. Is it okay to host the sitemap.xml outside www.example.com such as https://example.cloudstorage.com/static/sitemap.xml? All the entries in the sitemap ...
0
votes
1answer
134 views
Nested reference of URL'S in sitemap.xml good or bad for SEO?
I am having thousands of URL's in the website, If I put all URL's in sitemap.xml it's getting too large in size. There is some suggestion to split those URLs into different files and referring in main ...
2
votes
1answer
33 views
Optimize lastmod fields in sitemap index files for a large website that are expensive to compute
I am trying to create sitemaps for a very large multilingual website; means that every single URL is duplicated with as many languages there are; however the more pressing issue is that content is ...
0
votes
0answers
8 views
XML Sitemap submitted but few page show indexed via Google site: search [duplicate]
I submitted a sitemap of my website to Google. (japan1900.com)
The sitemap : (https://japan1900.com/en/module/lgsitemaps/sitemap?fc=module&name=product_1_1)
The robots.txt : https://japan1900.com/...
0
votes
0answers
12 views
How to target different countries using same URL? [duplicate]
We are based in India Digital Marketing company , we want to target us, uk, middle east countries with the same website, language is English.
How to tell to robots this from sitemap?
0
votes
0answers
11 views
Does Google index your sitemap? [duplicate]
I have submitted a sitemap for my domain but I have a concern. I don't want my sitemap to appear in Google Search results, I only want Google to use my sitemap to index my actual site through the ...
1
vote
0answers
66 views
Google Search Console cannot read my XML: Sitemap appears to be an HTML page
I'm working on a web application written with AngularJS (v8) and deployed on an apache2 using proxy to forward requests (frontend, api, backoffice).
My problem is that I'm trying to submit the ...
1
vote
1answer
127 views
Sitemap: Should I dynamically update sitemap for dynamic content or create a page containing all the dynamic links
Say i have the following route http://<my-domain>/{category}/subjects/{id}/{title}
the ones in the brackets are dynamic, I'm struggling with what is better or any better way to let google crawl ...
0
votes
0answers
155 views
Sitemap for one website in multiple domains
I have 2 domains (A and B). The first one (A) is the website.
In sitemap.xml of "A" domain, I have a sub-sitemap in "B" domain with "A" URLs.
A/sitemap.xml :
<...
1
vote
0answers
71 views
What URL am I supposed to use in <video:player_loc> for my sitemap when adding a YouTube video?
I'm somewhat confused. I'm following this example on how to create video sitemap. So say, I need to add the <video:video> tag to my page's sitemap that contains this YouTube video:
https://www....
0
votes
0answers
6 views
URL is not on Google [duplicate]
URL is not on Google
This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed. Learn more
Coverage
Discovery
Sitemaps N/A
Referring page None ...
0
votes
1answer
30 views
Google crawlbot parses & on sitemap.xml wrong
I have a sitemap.xml file with entries of the form:
<url>
<loc>https://www.example.com/?page=x&item=5</loc>
<changefreq>weekly</changefreq>
</url>
...
0
votes
1answer
83 views
Should I include a trailing slash for my <xhtml:link rel=“alternate” href=“URL” hreflang=“en-US”/> URLs?
I'm implementing hreflang on my web app.
Google does not mention anything on https://support.google.com/webmasters/answer/189077?hl=en
But they use it (trailing slashes) on their own Sitemap.
https:...
2
votes
1answer
26 views
Handling “rel hreflang” for specific languages in countries “en-US” and generic languages ex: “en”
If I have 3 english versions of my website:
/ FOR USA
/au FOR AUSTRALIA
/gb FOR United Kingdom
I would add them to my Sitemap using rel hreflang to serve those 3 countries:
Sitemap....
1
vote
0answers
11 views
Handling international SEO indexing for “country-specific” and “language-specific” URLs on the same website?
I'm developing an international website and this is my current situation.
My home URL is country-specific, i.e: every country has specific content that differs from the others.
/ USA
/au ...
2
votes
0answers
20 views
Google Search Console not finding all Sitemaps within Sitemap Index. How to fix? [duplicate]
I created a valid Sitemap Index (/sitemap-dec2019/sitemap_index.xml) for a site as follows:
<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/...
1
vote
1answer
32 views
My XML sitemap contains spam content, while the HTML sitemap is not. What can I do?
My website just recovered from an attack. I find out that my XML sitemap still contains spam contents:
<url>
<loc>http://xn--qucu-hr5aza.com/7pwclknq****hux0rx.so</loc>
<lastmod&...
