A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
1answer
16 views

Multiple Websites with Multiple Sitemaps under single IIS Endpoint

We have multiple websites with different domains under single IIS endpoint. Each website has its own sitemap - sitemap1.xml and sitemap2.xml. Can we implement rewrite rules so that www.example1.com/...
14
votes
5answers
5k views

& in sitemap links, are they correct?

Simple question, I'm asking just to make sure. A Google sitemap generator generated a sitemap.txt fle with links written like this: http://www.domain.com/category.htm?name=some-name&cat_id=8 ...
1
vote
2answers
47 views

Previously submitted my sitemap but now I changed most of my pages URLs, what should i do?

I had previously submitted my websites sitemap to google search console. It submitted all my pages and indexed most of them. However, recently I have changed most of my pages URLs due to SEO. Since I ...
1
vote
1answer
148 views

Must the image url in a sitemap file begin with the same domain the file is stored on?

I remember when making a sitemap, all URLs defined in between <loc> and </loc> must be part of the same domain as the domain the file is stored on. For example, I can use this line in my ...
2
votes
1answer
15 views

Historic sitemap contains <mobile:mobile/> - is an additional sitemap without it required?

We are reviewing an old sitemap which requires a refresh, and it contains the mobile tag for each URL (the site is dynamically served). Do we have to generate and upload an additional sitemap which ...
2
votes
2answers
36 views

Do I need to update the Last-modified HTTP header of my sitemap index?

I have a sitemap index pointing to about 8 sitemaps. The sitemaps get updated regularly, but my script only overwrites the sitemap index if the sitemap URLs change, and so the index's Last-modified ...
2
votes
1answer
41 views

Is it an SEO problem to link to short URLs that redirect to canonical URLs but put the canonical URLs in the sitemap?

I have a URL that I have added to my sitemap that reflects a health-tip entity http://www.example.com/health-tips/232344/this-is-perfect-for-your-health where 232344 is the id of the entity. ...
1
vote
1answer
68 views

Having trouble with Google indexing after extending SSL cert across whole site and resubmitting sitemap

I recently extended out SSL certification to every page on my website in an effort to gain some rank. I created and claimed the new https properties (both www and non www) in Google Search Console and ...
2
votes
0answers
50 views

Sitemap time stamps = negative SEO impact?

Recently experienced a 50% drop in traffic and one of the only things I changed is the sitemaps.xml We have 9 sitemaps with 50k URL each, I added the following formatting <URL>http://url.com&...
1
vote
0answers
18 views

Sitemap Generation for Large URL Website [closed]

I'm using Megento framework for My eCommerce website and have large number of url how do i create category wise sitemap list (or) with small number of urls sitemap files or any other solutions.......
0
votes
0answers
15 views

Indexing status from webmasters vs site:domainname.com method?

I went to google and typed in the search box site:example.com and I found out that there are 96 pages results on my website name. Below is the screenshot of it And I have submitted sitemaps using ...
0
votes
1answer
190 views

SEO - wrong sitemap links

My domain have about 40000 links and my sitemap was wrong generated. It was poiting to localhost instead public domain: <?xml version="1.0"?> <urlset xmlns="http://www.sitemaps.org/...
2
votes
1answer
386 views

change sitemap after 301 redirect

When I use 301 redirects for all URLs ... should i change sitemap URLs ??? ...... e.g: Sitemap contains bellow URLs example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html Should i ...
1
vote
0answers
31 views

Mobile Sitemap - Error 404 - WMT dont index it?

I have a site that is not responsive. It has 3 versions : PC, tablet and mobile, every version has different pages . I have made 2 sitemaps: one for the PC version and one for the mobile version. ...
2
votes
4answers
139 views

Is it ok to include sitemap URL in sitemap.xml

Does it have sense to include sitemap URL into sitemap? It is pointing to itself and in SEO perspective it's no use because if crawler is on our sitemap he already knows it, no need to inform it, ...
2
votes
1answer
22 views

Two sitemap.xml with wordpress in subfolder

I have a site at example.com which also hosts a wordpress blog at example.com/blog/ I am generating a sitemap.xml at my main site which also includes urls from my wordpress blog. What is the proper ...
0
votes
0answers
15 views

Google isn't crawling all Sitemap URLs [duplicate]

Googlebot isn't indexing our Sitemap http://i.stack.imgur.com/WkB1J.png There are 63 links in the Sitemap only two are indexed I've tried sending some link to the index by "fetch as Google" with no ...
8
votes
2answers
2k views

How long does Bingbot typically take to process a sitemap submission?

I submitted a domain's sitemap.xml to Bingbot (in Webmaster Tools). It's been a couple of days but the status is still pending. Does anyone know how much time does Bing Webmaster Tools takes to ...
2
votes
1answer
30 views

Is it bad practice to have “parent” sitemap name inconsistent with “child” sitemaps?

My client is using the Fitpro Theme for WordPress which comes with predefined post types i.e fitness_class. However he wanted it changed to "classes" for the permalink and seo reasons. So I made the ...
2
votes
1answer
40 views

Include “www” in sitemap URL in robots.txt when site redirects to no-www?

Website is redirected to remove the www so www.example.com is redirecting to example.com. Question is do I need to include the www in the sitemap for the robots.txt?
1
vote
0answers
20 views

I have two websites , one has over 8000 pages indexed the other has less than hundred,why is this happening? [closed]

Both sites were created with the same platform and have similar layout , their age is only a few days apart but one site is having problem getting indexed above 120pages out of the 18000+. I have ...
2
votes
0answers
51 views

Google search console reports URLs blocked by robots.txt even though they shouldn't be

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding ...
3
votes
1answer
52 views

URL in sitemap with temporary/dynamic noindex

Our scenario is we've got multiple pages set up for category-based browsing, such as example.com/products/boardgames A list of the canonical URLs for the categories is in the sitemap, with a frequency ...
2
votes
1answer
33 views

Allowing Google to index images on s3

We host our sites' static content on S3. We also have a very open robots.txt; User-agent: * Allow: * This is because in Webmaster tools I get thousands of warnings Sitemap contains urls which are ...
1
vote
1answer
44 views

Ask Google to refresh URLs in sitemap

I submitted an updated sitemap via Google Webmaster and I want Google to rescan URLs in it, as some of them are not yet found in Custom Search. I found an instruction for for CSE https://support....
0
votes
0answers
7 views

How to Create a sitemap in MEAN stack? [duplicate]

Well I am creating a Application in MEAN stack but I don't know how to crate a sitemap for MEAN stack
3
votes
1answer
81 views

Sitemap.xml on separate server (can't use robots.txt)

We have several domains managed by the same code base. They share content and assets between each other but are separate entities online. I have started generating sitemaps for these sites and ...
1
vote
1answer
33 views

How important is it to include <lastmod> in a sitemap?

In a sitemap, is it important to include information about when the url was last changed in a <lastmod> tag? How does not including a <lastmod> tag in a sitemap affect how my site is ...
6
votes
2answers
3k views

Is it necessary to submit sitemap to www and non www?

I have submitted my website to Google Webmaster Tools with both www and with no-www. I had made the domain without www to my preffered domain and have submitted a sitemap. My question is should I ...
1
vote
0answers
78 views

URLs not allowed error for one property, but not for the other?

All of our XML sitemaps are located on another domain than the domain they're referring to, for instance: - Sitemaps would be located at sitemap-domain.com/sitemap-1.xml - URLs being referenced in ...
7
votes
3answers
961 views

How soon Google is supposed to include new pages to search

I'm using Google CSE on my site. As soon as new entity is published, it's immediately added to sitemap.xml rendering script too. How soon after Googlebot fetches new sitemap new entities should be ...
1
vote
0answers
30 views

Is sitemap in sitemap_index getting indexed by Google webmaster?

it sounds a silly question, but I actually could not find a reference to it. I have created a sitemap_index with about 100-ish sitemaps. No errors. I submitted only the sitemap_index to Google ...
3
votes
1answer
139 views

Submitting a URL to Google using PHP/cUrl

I've been successfully submitting xml sitemaps to Google using cURL. The URL is http://www.google.com/webmasters/sitemaps/ping?sitemap= The problem is that XML sitemaps take several days to be ...
2
votes
0answers
36 views

Which is faster for sitemap submission: ping or submit via search console?

Previously I asked a question about marking sitemap warnings as fixed here: Resetting sitemap warnings in Webmaster Tools I look in my account today and find such warnings and errors are always ...
2
votes
2answers
61 views

Sitemap compressed is in unsupported format but valid if uncompressed

I've build a sitemap_index pointing to different sitemaps "sitemap1.xml" If they are uncompressed, they are successfully validated and accepted (Google Webmaster). However, when compressed, they are ...
1
vote
0answers
26 views

Ping Sitemap or Individual URL

On self hosted wordpress blogs when you update a post it automatically pings services such as pingomatic etc. This sends the URL of the updated post and not the xml sitemap. What's more beneficial? I ...
0
votes
1answer
35 views

Should I be using both “rel=canonical” and “rel=”alternate" within my sitemap?

I followed this setup in my sitemap that Google outlines on this page: https://support.google.com/webmasters/answer/189077?hl=en . <url> <loc>http://example.com/en</loc> <xhtml:...
3
votes
1answer
37 views

Internal links to pages vs. sitemap.xml links to pages

I have a page that is not linked to from anywhere, but it is listed in sitemap.xml. It will be crawled and display in the SERP. Would it be preferable, from a SEO perspective, to have the page ...
0
votes
0answers
17 views

Google sitemaps: Url is not allowed at this location

Hi I have made a sitemap for my website. I went to google search console and added my sitemap.xml when I click test it displays the details and says that all 8 URL's are not allowed? what have I done ...
0
votes
1answer
662 views

1000 page submit limit in Google Webmaster Tools sitemap

I'm currently managing Webmaster Tools for some Wordpress sites and I'm curious as to why none of the sites are showing more than 1000 pages submitted. Some of the sites are much larger but I can't ...
1
vote
0answers
66 views

Google can't crawl my rewritten URLs

I tried to submit my robots.txt and sitemap.xml for hours now - changing directories and .htacces rules like a horse. For some stupid reason Google can't crawl my pages and gives me warnings, that my ...
1
vote
2answers
103 views

Blogger sitemap for Webmaster Tools

I'm developing a new Blogger Blog, and I'm about to send its first sitemap to Google Webmaster Tools. The thing is, I've found 2 articles about Blogger sitemaps, in which one is suggesting to send the ...
2
votes
0answers
36 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - http://example.com/sitemap....
3
votes
1answer
151 views

Can HTML sitemaps be listed in robots.txt just like XML sitemaps?

I will have two sitemaps for my website. The first sitemap is the .xml version for the search engines. The second sitemap is a sitemap.php on my website for the users. I know I can list the sitemap....
1
vote
3answers
44 views

Does the sitemap necessarily need to be in the root folder?

I have created a sitemap index and all the additional sitemaps that I want to upload into webmasters tools. Do I need to keep them in the root folder or can I just create a folder called "sitemaps" ...
0
votes
2answers
62 views

How can I compare sitemaps between two sites (staging and production)

I have rebuilt a site for a client but want to limit the SEO fallout upon deployment of their new website. How can I compare sitemaps from both sites in an effort to make sure that the sites are ...
2
votes
1answer
54 views

Forcing google to rescan sitemaps instantly

When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error). I created a script that allows my co-administrator to add and remove pictures from the site and ...
1
vote
2answers
60 views

Google Structured Data and sitemap resubmit?

I've submitted sitemap in google search console a few weeks ago and slowly being indexed. I just implemented Google Structure Data to all the pages. How strong does it for the data to show up in ...
3
votes
2answers
210 views

How should you inform search engines of the location of an XML sitemap?

There are 2 ways to make search engines aware of a sitemap's location that I know of: Include an absolute link to it in robots.txt Submit it to them directly. The relevant URLs are: http://www....