Questions tagged [sitemap]
A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
812
questions
5
votes
1
answer
419
views
What is difference between robots.txt, sitemap, robots meta tag, robots header tag?
So I am trying to learn SEO and I am honestly confused and have following 8 questions.
Do I tell a bot not to visit a certain link through X-Robots-Tag or through robot meta tag or robots.txt?
Is it ...
- 175
0
votes
1
answer
79
views
Maintaining 1 sitemap.xml in two subdomains
Im trying to include an auto-generated sitemap.xml file whenever we build our frontend application.
Unfortunately due to legacy reasons, we use the same frontend build script on our production and ...
- 133
1
vote
2
answers
45
views
Notify search engines on 404 pages
How to pro-actively notify search engines (Google and others) of removed pages 404s that are still indexed?
- 113
0
votes
1
answer
763
views
Is it okay to host sitemap.xml outside the domain root?
Let's say I have a website www.example.com. Is it okay to host the sitemap.xml outside www.example.com such as https://example.cloudstorage.com/static/sitemap.xml? All the entries in the sitemap ...
- 103
1
vote
1
answer
511
views
Is nested reference of URLs in sitemap.xml good or bad for SEO?
I am having thousands of URLs in the website, If I put all URLs in sitemap.xml it's getting too large in size. There is some suggestion to split those URLs into different files and referring in main ...
- 113
2
votes
1
answer
243
views
Optimize lastmod fields in sitemap index files for a large website that are expensive to compute
I am trying to create sitemaps for a very large multilingual website; means that every single URL is duplicated with as many languages there are; however the more pressing issue is that content is ...
- 121
0
votes
0
answers
9
views
XML Sitemap submitted but few page show indexed via Google site: search [duplicate]
I submitted a sitemap of my website to Google. (japan1900.com)
The sitemap : (https://japan1900.com/en/module/lgsitemaps/sitemap?fc=module&name=product_1_1)
The robots.txt : https://japan1900.com/...
- 1
1
vote
0
answers
137
views
Google Search Console cannot read my XML: Sitemap appears to be an HTML page
I'm working on a web application written with AngularJS (v8) and deployed on an apache2 using proxy to forward requests (frontend, api, backoffice).
My problem is that I'm trying to submit the ...
- 11
1
vote
1
answer
745
views
Sitemap: Should I dynamically update sitemap for dynamic content or create a page containing all the dynamic links
Say i have the following route http://<my-domain>/{category}/subjects/{id}/{title}
the ones in the brackets are dynamic, I'm struggling with what is better or any better way to let google crawl ...
- 123
0
votes
0
answers
534
views
Sitemap for one website in multiple domains
I have 2 domains (A and B). The first one (A) is the website.
In sitemap.xml of "A" domain, I have a sub-sitemap in "B" domain with "A" URLs.
A/sitemap.xml :
<...
- 1
2
votes
1
answer
346
views
What URL am I supposed to use in <video:player_loc> for my sitemap when adding a YouTube video?
I'm somewhat confused. I'm following this example on how to create video sitemap. So say, I need to add the <video:video> tag to my page's sitemap that contains this YouTube video:
https://www....
- 151
0
votes
1
answer
50
views
Google crawlbot parses & on sitemap.xml wrong
I have a sitemap.xml file with entries of the form:
<url>
<loc>https://www.example.com/?page=x&item=5</loc>
<changefreq>weekly</changefreq>
</url>
...
- 103
0
votes
1
answer
279
views
Should I include a trailing slash for my <xhtml:link rel="alternate" href="URL" hreflang="en-US"/> URLs?
I'm implementing hreflang on my web app.
Google does not mention anything on https://support.google.com/webmasters/answer/189077?hl=en
But they use it (trailing slashes) on their own Sitemap.
https:...
- 968
3
votes
1
answer
38
views
Handling "rel hreflang" for specific languages in countries "en-US" and generic languages ex: "en"
If I have 3 english versions of my website:
/ FOR USA
/au FOR AUSTRALIA
/gb FOR United Kingdom
I would add them to my Sitemap using rel hreflang to serve those 3 countries:
Sitemap....
- 968
2
votes
0
answers
16
views
Handling international SEO indexing for "country-specific" and "language-specific" URLs on the same website?
I'm developing an international website and this is my current situation.
My home URL is country-specific, i.e: every country has specific content that differs from the others.
/ USA
/au ...
- 968
2
votes
0
answers
28
views
Google Search Console not finding all Sitemaps within Sitemap Index. How to fix? [duplicate]
I created a valid Sitemap Index (/sitemap-dec2019/sitemap_index.xml) for a site as follows:
<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/...
- 388
1
vote
1
answer
138
views
My XML sitemap contains spam content, while the HTML sitemap is not. What can I do?
My website just recovered from an attack. I find out that my XML sitemap still contains spam contents:
<url>
<loc>http://xn--qucu-hr5aza.com/7pwclknq****hux0rx.so</loc>
<lastmod&...
- 604
1
vote
0
answers
18
views
Where do I place sitemap for fourth level domain?
Where should I place sitemap.xml file in case of fourth level domain (e.g. en.subdomain.example.com)?
From sitemaps.org:
All URLs listed in the Sitemap must reside on the same host as the
...
- 223
1
vote
1
answer
32
views
Googlebot keeps indexing old pages
Recently, I moved all pages from subdomain.domain.com/<lang>/ to <lang>.subdomain.domain.com and submitted new sitemap.xml in Google Search console inteface.
From the server logs, I see ...
- 223
1
vote
0
answers
7
views
Google is not indexing an original post, but indexing pagination page and facebook post [duplicate]
I built https://talksub.com/, and I am having trouble with SEO for individual posts.
I implemented JSON-LD and have all necessary meta tags like (title, description, canonical url, og, twitter ...) ...
- 111
1
vote
0
answers
66
views
Is it possible to create txt sitemaps index file?
I am creating sitemaps using Google Search Console and we are exploring an option of creating txt sitemaps.
There are many sitemaps so using a sitemaps index file is basically a requirement but I ...
- 111
1
vote
1
answer
204
views
Search Console URL Inspection shows "URL is not on Google" even though I can find it through Google search
I am using Google Search Console's URL Inspection Tool but I am not exactly sure how it works.
I have submitted a sitemap to Google Search Console and the link shows up in google search but when I ...
- 51
1
vote
1
answer
107
views
How to check if sitemap index has been successfully submitted and can be properly read
Recently, I have submitted a sitemap index with a slew of xml files and URL links.
I see that the sitemap index has been successfully submitted and I understand that the discovered URLs is possible ...
- 51
3
votes
1
answer
2k
views
Your Sitemap or Sitemap index file does not properly declare the namespace!
This is my sitemap, it starts like this:
<?xml version="1.0" encoding="UTF-8"?>
<urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/...
1
vote
1
answer
51
views
Is there an SEO or pagerank benefit in grouping (rel="alternate") multi-language websites (using multiple domains) together?
I'm building this website that will be multi-region / multi-language.
And for that, Google suggests the following:
https://support.google.com/webmasters/answer/182192?hl=en
Since, my domain will ...
- 968
1
vote
1
answer
31
views
In 2020, is there an established approach to describe an international site using XML sitemaps?
I've been writing XML Sitemaps for a decade, but I've never before needed to write an XML Sitemap for an international site.
It occurs to me that there are three clear approaches (and there may be ...
0
votes
2
answers
6k
views
Google indexed my sitemap successfully but showing 0 URLs discovered. How do I fix that?
About two weeks ago, I submitted my sitemap in webmaster of my site https://example.com. It's successfully index, but there's not any single URL discovered. It shows 0 there now. Three weeks have ...
- 11
1
vote
2
answers
244
views
Google Sitemap tree results showing up as 0
I've made a Google Sitemap Tree, ie linking child xml files to the main xml. However, Google Search Console shows that 0 pages are discovered for the parent sitemap xml. Is Google Search Console not ...
- 51
1
vote
1
answer
138
views
How to efficiently update the sitemap without losing previous indexes?
I have a sitemap uploaded for my web application. The webmasters has indexed 10% of all the URLs in sitemap so far and marked the remaining as excluded(discovered not indexed). I have made some ...
- 111
1
vote
0
answers
43
views
Google Search Console is not fetching the sitemap correctly?
Search Console is not fetching the sitemap when it is named as “Sitemap.xml”, after we renamed it as “Sitemapnew.xml” sitemap is submitted successfully??
4,630 URL”S were discovering even after we ...
1
vote
1
answer
215
views
Google Search Console Adding Sitemap "Couldn't fetch" and "Sitemap could not be read" txt file
I made a fairly simple .txt file
I am getting the following errors
I find it very odd. The 2.txt is just the .txt with fewer than 50,000 results. Somehow it seems like Google can read the longer .txt ...
- 111
0
votes
1
answer
48
views
Changed URL for a page that was indexed by Googlebot. Will redirect 301 from the old URL to the new one. But what to do with my Sitemap?
I'm planning to change a url for one of my site's page.
Example:
From: https://www.example.com/old-post-slug
To: https://www.example.com/new-post-slug
The fact is that Google has already ...
- 968
1
vote
1
answer
785
views
I am not able to generate .XML sitemap through xml-sitemaps.com
I want to generate an XML sitemap for my website. Since my website's CMS is custom PHP and the blog's CMS is Wordpress. Here is my website provided below:
My problem is that I am not able to generate ...
- 61
1
vote
1
answer
32
views
Should I create a sitemap for only a few images?
Most of the images on my website are found and indexed correctly by search engines. However, some of the images are in tags that aren't indexed by Google.
If I create a sitemap for only these types ...
- 155
1
vote
1
answer
68
views
Google shows "General HTP error" fetching sitemap and no pages indexed from my site
I am working on a project that just rebranded.
Using Google Search Console I am getting some weird errors.
Despite my sitemap_index.xml and robot.txt working properly, google cannot seem to fetch it ...
- 111
3
votes
1
answer
41
views
Add URL to sitemap to be available in the future
I generate automatically the sitemap.xml on publish of content on my website, however some of the content will be publish starting from an specific date and time.
Is there any tag that I can add to a ...
- 31
1
vote
3
answers
173
views
Is there a default sitemap filepath? If not, why not?
For example, the Robots Exclusion Protocol specifies /robots.txt as the filepath.
Does the sitemap protocol specify, eg, /sitemap.xml as the default filepath?
If not, why not? For my personal ...
- 105
7
votes
3
answers
3k
views
Google says my sitemap index was "processed successfully", yet "total discovered URLs" is 0
I submitted a new version of the sitemap index for my site in Google Search Console two days ago. Soon after submission, GSC started saying that the index was "processed successfully", and yet has ...
- 274
1
vote
0
answers
156
views
How to create a sitemap for my sub-sites that duplicate pages from my main site?
I have a website containing around 8000 vacancies (and growing each day): https://www.example.com , this website consists (at the moment) out of 3 languages, www.example.com/nl-be/, www.example.com/fr-...
- 111
0
votes
0
answers
17
views
In a sitemap, should I update the lastmod tag of a url based on the text content or html content? [duplicate]
Imagine I have this blogging / ecommerce website with 1000 posts / products. And I've built a sitemap for it, which is dynamically generated. Basically it's a list with a bunch of <url> and <...
- 968
1
vote
1
answer
133
views
If I make changes in the template I use for a product page, do I need to update all <lastmod> tags for all product pages in my sitemap.xml?
I'm currently building a sitemap for my web app.
Note: my app is a single page app built with React and Firebase.
Basically I wan to index blogPost and product pages. So I intend to generate my ...
- 968
1
vote
1
answer
31
views
Create a sitemap of the directory tree of website from a link
After trying all the online services I haven't been able to create a sitemap of the following link (for which http://amd.cdn.example.com/adultswim/episodes//us_geo/ should be the starting point)
http:...
- 111
3
votes
1
answer
147
views
Would Google accept a text sitemap if the URL had a .php extension?
Google accepts a sitemap as .txt file with a list of URLs separated each by a newline.
Would Google also allow the same text file format with a .php? Ie.mysitemap.php instead of mysitemap.txt?
- 143
2
votes
0
answers
290
views
Can alternate URLs for hreflinks be in different XML sitemap files when using <xml:link rel="alternate"
Regarding the XML sitemaps (that use alternative languages), in this page it is specified the following:
Common Mistakes
Here are the most common mistakes with hreflang usage:
Missing return links: ...
- 121
16
votes
3
answers
7k
views
Google Search Console is making up URLs which don't exist in my Sitemap and then complains that these pages have error
I am working on an e-commerce website. I used to have a sitemap with category Ids, something like:
<url>
<loc>https://my-domain.com/home/browse/2/45/139</loc>
<changefreq&...
- 538
1
vote
2
answers
66
views
Google Search Console reports it is not crawling the hompage but it shows up in a site: search
I recently retouched a corporate site for a client. They also have an ecommerce version of their site at another URL. I've submitted the sitemap and did a manual re-crawl request for the homepage of ...
0
votes
1
answer
40
views
Change image names or create an image sitemap? Or both?
The environment is a classifieds site, where there's products with their description, title and photos and, except for images, all data is stored in a MySQL database.
Although there's friendly titles ...
0
votes
0
answers
182
views
Using prerender.io for SEO on my AngularJS app - Dynamic and static web pages
I have a website that was built with AngularJS. I want the website to be crawled by search engines (with the dynamic content).
I've tried to use Google services to do the crawl (from a sitemap.xml ...
2
votes
2
answers
2k
views
Why the new Google Search Console does not read my sitemap?
I have the following problem:
I cannot submit any sitemap recently to Google Search Console.
Let me give you an example:
https://ru.azrhymes.com/static/sitemaps/ru/sitemap-main-1.xml.
(validator says ...
- 145
4
votes
2
answers
1k
views
How many links per page maximum can we have in an HTML sitemap?
In the XML sitemap, there is a limit of 50,000 per XML sitemap. Is there a limit of links to be present on the HTML based sitemap?
If I have more than 100k pages or posts, Should I used them as ...
