A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
1answer
17 views

Multiple Websites with Multiple Sitemaps under single IIS Endpoint

We have multiple websites with different domains under single IIS endpoint. Each website has its own sitemap - sitemap1.xml and sitemap2.xml. Can we implement rewrite rules so that www.example1.com/...
2
votes
1answer
15 views

Historic sitemap contains <mobile:mobile/> - is an additional sitemap without it required?

We are reviewing an old sitemap which requires a refresh, and it contains the mobile tag for each URL (the site is dynamically served). Do we have to generate and upload an additional sitemap which ...
2
votes
2answers
36 views

Do I need to update the Last-modified HTTP header of my sitemap index?

I have a sitemap index pointing to about 8 sitemaps. The sitemaps get updated regularly, but my script only overwrites the sitemap index if the sitemap URLs change, and so the index's Last-modified ...
2
votes
1answer
41 views

Is it an SEO problem to link to short URLs that redirect to canonical URLs but put the canonical URLs in the sitemap?

I have a URL that I have added to my sitemap that reflects a health-tip entity http://www.example.com/health-tips/232344/this-is-perfect-for-your-health where 232344 is the id of the entity. ...
1
vote
2answers
49 views

Previously submitted my sitemap but now I changed most of my pages URLs, what should i do?

I had previously submitted my websites sitemap to google search console. It submitted all my pages and indexed most of them. However, recently I have changed most of my pages URLs due to SEO. Since I ...
1
vote
0answers
19 views

Sitemap Generation for Large URL Website [closed]

I'm using Megento framework for My eCommerce website and have large number of url how do i create category wise sitemap list (or) with small number of urls sitemap files or any other solutions.......
2
votes
0answers
50 views

Sitemap time stamps = negative SEO impact?

Recently experienced a 50% drop in traffic and one of the only things I changed is the sitemaps.xml We have 9 sitemaps with 50k URL each, I added the following formatting <URL>http://url.com&...
0
votes
0answers
15 views

Indexing status from webmasters vs site:domainname.com method?

I went to google and typed in the search box site:example.com and I found out that there are 96 pages results on my website name. Below is the screenshot of it And I have submitted sitemaps using ...
2
votes
1answer
22 views

Two sitemap.xml with wordpress in subfolder

I have a site at example.com which also hosts a wordpress blog at example.com/blog/ I am generating a sitemap.xml at my main site which also includes urls from my wordpress blog. What is the proper ...
0
votes
0answers
15 views

Google isn't crawling all Sitemap URLs [duplicate]

Googlebot isn't indexing our Sitemap http://i.stack.imgur.com/WkB1J.png There are 63 links in the Sitemap only two are indexed I've tried sending some link to the index by "fetch as Google" with no ...
2
votes
1answer
30 views

Is it bad practice to have “parent” sitemap name inconsistent with “child” sitemaps?

My client is using the Fitpro Theme for WordPress which comes with predefined post types i.e fitness_class. However he wanted it changed to "classes" for the permalink and seo reasons. So I made the ...
2
votes
1answer
40 views

Include “www” in sitemap URL in robots.txt when site redirects to no-www?

Website is redirected to remove the www so www.example.com is redirecting to example.com. Question is do I need to include the www in the sitemap for the robots.txt?
1
vote
0answers
20 views

I have two websites , one has over 8000 pages indexed the other has less than hundred,why is this happening? [closed]

Both sites were created with the same platform and have similar layout , their age is only a few days apart but one site is having problem getting indexed above 120pages out of the 18000+. I have ...
2
votes
0answers
52 views

Google search console reports URLs blocked by robots.txt even though they shouldn't be

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding ...
2
votes
1answer
33 views

Allowing Google to index images on s3

We host our sites' static content on S3. We also have a very open robots.txt; User-agent: * Allow: * This is because in Webmaster tools I get thousands of warnings Sitemap contains urls which are ...
1
vote
1answer
45 views

Ask Google to refresh URLs in sitemap

I submitted an updated sitemap via Google Webmaster and I want Google to rescan URLs in it, as some of them are not yet found in Custom Search. I found an instruction for for CSE https://support....
0
votes
0answers
7 views

How to Create a sitemap in MEAN stack? [duplicate]

Well I am creating a Application in MEAN stack but I don't know how to crate a sitemap for MEAN stack
1
vote
1answer
33 views

How important is it to include <lastmod> in a sitemap?

In a sitemap, is it important to include information about when the url was last changed in a <lastmod> tag? How does not including a <lastmod> tag in a sitemap affect how my site is ...
7
votes
3answers
961 views

How soon Google is supposed to include new pages to search

I'm using Google CSE on my site. As soon as new entity is published, it's immediately added to sitemap.xml rendering script too. How soon after Googlebot fetches new sitemap new entities should be ...
3
votes
1answer
81 views

Sitemap.xml on separate server (can't use robots.txt)

We have several domains managed by the same code base. They share content and assets between each other but are separate entities online. I have started generating sitemaps for these sites and ...
1
vote
0answers
30 views

Is sitemap in sitemap_index getting indexed by Google webmaster?

it sounds a silly question, but I actually could not find a reference to it. I have created a sitemap_index with about 100-ish sitemaps. No errors. I submitted only the sitemap_index to Google ...
2
votes
0answers
36 views

Which is faster for sitemap submission: ping or submit via search console?

Previously I asked a question about marking sitemap warnings as fixed here: Resetting sitemap warnings in Webmaster Tools I look in my account today and find such warnings and errors are always ...
2
votes
2answers
61 views

Sitemap compressed is in unsupported format but valid if uncompressed

I've build a sitemap_index pointing to different sitemaps "sitemap1.xml" If they are uncompressed, they are successfully validated and accepted (Google Webmaster). However, when compressed, they are ...
1
vote
0answers
26 views

Ping Sitemap or Individual URL

On self hosted wordpress blogs when you update a post it automatically pings services such as pingomatic etc. This sends the URL of the updated post and not the xml sitemap. What's more beneficial? I ...
3
votes
1answer
142 views

Submitting a URL to Google using PHP/cUrl

I've been successfully submitting xml sitemaps to Google using cURL. The URL is http://www.google.com/webmasters/sitemaps/ping?sitemap= The problem is that XML sitemaps take several days to be ...
3
votes
1answer
37 views

Internal links to pages vs. sitemap.xml links to pages

I have a page that is not linked to from anywhere, but it is listed in sitemap.xml. It will be crawled and display in the SERP. Would it be preferable, from a SEO perspective, to have the page ...
0
votes
0answers
17 views

Google sitemaps: Url is not allowed at this location

Hi I have made a sitemap for my website. I went to google search console and added my sitemap.xml when I click test it displays the details and says that all 8 URL's are not allowed? what have I done ...
1
vote
0answers
68 views

Google can't crawl my rewritten URLs

I tried to submit my robots.txt and sitemap.xml for hours now - changing directories and .htacces rules like a horse. For some stupid reason Google can't crawl my pages and gives me warnings, that my ...
2
votes
0answers
36 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - http://example.com/sitemap....
3
votes
1answer
152 views

Can HTML sitemaps be listed in robots.txt just like XML sitemaps?

I will have two sitemaps for my website. The first sitemap is the .xml version for the search engines. The second sitemap is a sitemap.php on my website for the users. I know I can list the sitemap....
2
votes
1answer
54 views

Forcing google to rescan sitemaps instantly

When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error). I created a script that allows my co-administrator to add and remove pictures from the site and ...
0
votes
2answers
62 views

How can I compare sitemaps between two sites (staging and production)

I have rebuilt a site for a client but want to limit the SEO fallout upon deployment of their new website. How can I compare sitemaps from both sites in an effort to make sure that the sites are ...
1
vote
3answers
45 views

Does the sitemap necessarily need to be in the root folder?

I have created a sitemap index and all the additional sitemaps that I want to upload into webmasters tools. Do I need to keep them in the root folder or can I just create a folder called "sitemaps" ...
2
votes
1answer
46 views

Redirected site to www and submitted www URLs but Search Console only shows 5 pages indexed

Recently I submitted the www version of my site to Google Search Console and 301 redirected all URLs from non-www to www. I submitted the URLs in my sitemap.xml. The problem is that I've submitted 62 ...
3
votes
1answer
92 views

If I rename a sitemap, does it affect my SEO?

I would like to rename my sitemap: Would it affect my SEO at all? Would I have to resubmit it on GWT? If I have a sitemap-index.xml file, that remains the same, but I change the name of one of the ...
2
votes
1answer
61 views

Does Google prefer HTML sitemaps or XML sitemaps? And does it hurt to implement both?

I just read that Google prefers HTML sitemaps. We have so far, only implemented an XML sitemap. Would it hurt to add an HTML sitemap, and not remove the XML sitemap? Also, can you submit the HTML ...
1
vote
2answers
50 views

Why do some websites hide their sitemaps and exclude mentioning it from the robots.txt file? Does this affect SEO at all?

A lot of websites hide their sitemap.xml file. What I mean by this is that they make the URL something that a person cannot guess and then do not mention them in the robots.txt file. So my question ...
0
votes
1answer
35 views

Should I be using both “rel=canonical” and “rel=”alternate" within my sitemap?

I followed this setup in my sitemap that Google outlines on this page: https://support.google.com/webmasters/answer/189077?hl=en . <url> <loc>http://example.com/en</loc> <xhtml:...
1
vote
1answer
117 views

Submitting sitemap to Google Search Console: “General HTTP error: Domain name not found”

I'm having a lot of trouble getting google search console to work with my wordpress website. I'm hosting the website myself on VPS. Everytime i try to insert xml sitemap i get General HTTP error: ...
1
vote
1answer
31 views

Is it OK that I submitted sitemaps for www and no-www?

I have submitted two sitemaps of the same website. One for www and one for no the www version of my website. Should I delete one of the 2 sitemaps on the URL with redirect? In that case I would leave ...
1
vote
1answer
43 views

The Yandex index robot is redirected when requesting this site so the robots.txt file will not be used. What's the fix?

We have a website: www.example.com which redirects to https://www.example.com. Therefore when you type www.example.com/robots.txt you are redirected to https://www.example.com/robots.txt. Another ...
2
votes
0answers
53 views

Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything. Here is my AVS tube robots.txt: User-agent: * Allow: / Disallow: /...
4
votes
1answer
53 views

Moving folder's content to a new domain, what SEO steps to take?

So, we have a functionality on example.com/folder that we decided to make as separate site and we're in need of moving it to a new domain (brand it)... This is what I'm going to make SEO wise (...
4
votes
2answers
58 views

Possible to check which links in a sitemap are indexed and which ones aren't?

Is it possible to check which links of the sitemap I've submitted are being indexed, and which ones are not? I've submitted my sitemap.xml without errors. When I check the sitemap in google search ...
2
votes
1answer
19 views

Lower priority for specific pages

I have some documents that are not as important and I would like to have a lower priority for them. If I generate a sitemap I can set the priority for these pages to a lower value, e.g. 0.1. ...
1
vote
1answer
41 views

Robots.txt disallow all except one directory and access to sitemap

robots.txt containts following instructions: User-agent: * Allow: /public/ Disallow: / Sitemap: http://sitedomain.com/sitemapindex.xml it seems that in this case sitemapindex won't be accessible ...
1
vote
1answer
69 views

Having trouble with Google indexing after extending SSL cert across whole site and resubmitting sitemap

I recently extended out SSL certification to every page on my website in an effort to gain some rank. I created and claimed the new https properties (both www and non www) in Google Search Console and ...
0
votes
2answers
45 views

Sitemap XML title in search results

I have a website that uses an XML sitemap and a robots.txt file. If I do a Google search of: site: mywebsite.co.uk "sitemap" I see the usual Google response, similar to the following image, ...
0
votes
0answers
10 views

How to Submit Website to Baidu [duplicate]

I'm looking for a guide to submit my website to Baidu, I found a tutorial in the related posts from this site, but it isn't updated and they require a mobile phone, which I don't have.
0
votes
1answer
166 views

Create a site map for my asp.net mvc web site that can be crawled by the search engines

I have created a web site using asp.net mvc-5 . and I have hosted it to one of the hosting provider and I register the web site with Google app. Now after 1.5 months of publishing the web site online ...