A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

3
votes
2answers
32 views

Possible to check which links in a sitemap are indexed and which ones aren't?

Is it possible to check which links of the sitemap I've submitted are being indexed, and which ones are not? I've submitted my sitemap.xml without errors. When I check the sitemap in google search ...
1
vote
1answer
16 views

Having trouble with Google indexing after extending SSL cert across whole site and resubmitting sitemap

I recently extended out SSL certification to every page on my website in an effort to gain some rank. I created and claimed the new https properties (both www and non www) in Google Search Console and ...
2
votes
1answer
13 views

Lower priority for specific pages

I have some documents that are not as important and I would like to have a lower priority for them. If I generate a sitemap I can set the priority for these pages to a lower value, e.g. 0.1. ...
2
votes
1answer
32 views

Google Structured Data and sitemap resubmit?

I've submitted sitemap in google search console a few weeks ago and slowly being indexed. I just implemented Google Structure Data to all the pages. How strong does it for the data to show up in ...
1
vote
1answer
18 views

Robots.txt disallow all except one directory and access to sitemap

robots.txt containts following instructions: User-agent: * Allow: /public/ Disallow: / Sitemap: http://sitedomain.com/sitemapindex.xml it seems that in this case sitemapindex won't be accessible ...
1
vote
2answers
70 views

Blogger sitemap for Webmaster Tools

I'm developing a new Blogger Blog, and I'm about to send its first sitemap to Google Webmaster Tools. The thing is, I've found 2 articles about Blogger sitemaps, in which one is suggesting to send the ...
0
votes
2answers
23 views

Sitemap XML title in search results

I have a website that uses an XML sitemap and a robots.txt file. If I do a Google search of: site: mywebsite.co.uk "sitemap" I see the usual Google response, similar to the following image, ...
1
vote
1answer
59 views

Can a sitemap be hosted off-site (e.g., in s3) if you 301 redirect to it?

We compute our sitemap periodically with a chron job and store the results in s3. Can we 301 redirect https://oursite.com/sitemap.xml to the sitemap.xml hosted on s3? I know that the sitemap spec ...
1
vote
1answer
33 views

URL in sitemap with temporary/dynamic noindex

Our scenario is we've got multiple pages set up for category-based browsing, such as example.com/products/boardgames A list of the canonical URLs for the categories is in the sitemap, with a frequency ...
7
votes
2answers
952 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
2
votes
2answers
216 views

When the page language can be determined by the browser settings, which URLs should go into sitemaps?

At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website ...
1
vote
1answer
97 views

Must the image url in a sitemap file begin with the same domain the file is stored on?

I remember when making a sitemap, all URLs defined in between <loc> and </loc> must be part of the same domain as the domain the file is stored on. For example, I can use this line in my ...
0
votes
1answer
41 views

SEO strategy for dynamic images ( PHP + GD )

I have several images which are generated by using PHP + GD. They consist of a background image, and colored lines drawn on top of the images. As the possible combinations depend on the behaviour of ...
0
votes
2answers
2k views

How does removing pages from a site affect Google SEO?

I have been told by one of my clients that Google must be notified if you intend to remove pages (e.g. discontinued product pages) from a site, because Google will penalize your search results if you ...
0
votes
0answers
10 views

How to Submit Website to Baidu [duplicate]

I'm looking for a guide to submit my website to Baidu, I found a tutorial in the related posts from this site, but it isn't updated and they require a mobile phone, which I don't have.
1
vote
3answers
46 views

How to have multiple sitemaps for multiple domains hosted on one hosting account?

I have two domains pointing to the same hosting account. My code in the index.php page recognizes which domain and shows different content for each domain. However, both domains have the same ...
0
votes
1answer
48 views

Create a site map for my asp.net mvc web site that can be crawled by the search engines

I have created a web site using asp.net mvc-5 . and I have hosted it to one of the hosting provider and I register the web site with Google app. Now after 1.5 months of publishing the web site online ...
1
vote
1answer
13 views

What Gzip compression level can safely be used for sitemap files?

I can use PHP's gzencode function to set the compression level of data to compress and I want to compress my sitemap files then submit them to google. Currently my compression level is set to 2 ...
2
votes
2answers
27 views

Should we include images in sitemap to index?

The sitemap of my website is currently indexing only posts and pages. It is not indexing the media content that is images and attachments. Is it a good idea not to submit images for indexing. If not ...
2
votes
2answers
64 views

Sitemap is “pending” in Webmaster Tools after submitting an an unusually large number of links with it

I recently submitted to Google 17,000 links to businesses in my database. In the past I've only ever submitted 2 or 3 hundred. The sitemap has been listed in Webmaster Tools for the past five days ...
1
vote
1answer
17 views

Google Webmaster Tools 'index status' and 'sitemaps' are not consistent

In Google Webmaster Tools, Google Index -> Index Status shows 40 indexed pages: However Crawl > Sitemaps shows 5 indexed pages, and 35 submitted: There are no crawl errors in the sitemap. Why ...
0
votes
1answer
28 views

XML Sitemap upload for Wordpress site

I had previously used an XML Sitemap auto generator on the AIOSEO plugin but wanted to make some changes to the prioritization of some of the URLs that I could not change through the functions of the ...
0
votes
1answer
590 views

1000 page submit limit in Google Webmaster Tools sitemap

I'm currently managing Webmaster Tools for some Wordpress sites and I'm curious as to why none of the sites are showing more than 1000 pages submitted. Some of the sites are much larger but I can't ...
2
votes
1answer
11 views

How would search engines notify us about errors with live sitemaps?

We have been asked to generate sitemaps to assist robots indexing our site because we generate content dynamically. So far, we can create those maps just fine and they seem to pass XML validators just ...
1
vote
1answer
50 views

What are the different types of XML sitemaps that can be submitted to search engines?

I recently came to know about Image sitemaps. Can someone list ALL possible types of sitemaps currently used for listing entire website to search engines?
0
votes
1answer
17 views

Omit bad content in sitemap

My site basically consists out of user generated content (UGC). A user can submit a tutorial. Other users can vote on tutorials. Ratings can be negative too, SE style more or less. Now I want to ...
1
vote
0answers
64 views

hreflang tags in sitemaps - your site has no hreflang tags

We are using hreflang tags in our sitemaps and we're currently experiencing a number of issues with errors in WMT suggesting 'no return tags' and 'your site has no hreflang tags' that don't seem ...
2
votes
1answer
35 views

How to index the right page?

My website is crawled and indexed by Google. However, one of my problem is that the indexed pages are sometimes not the right one. For example, let's say that I have star wars video on my website, ...
2
votes
3answers
114 views

Is it ok to include sitemap URL in sitemap.xml

Does it have sense to include sitemap URL into sitemap? It is pointing to itself and in SEO perspective it's no use because if crawler is on our sitemap he already knows it, no need to inform it, ...
2
votes
3answers
4k views

Sitemap for a one-page site

I'm wondering whether it's worth the effort to create a sitemap for a single-page site. By single page I'm not talking about a webapp made with Angular or Backbone, just a presentation site/page ...
0
votes
1answer
118 views

Sitemap for site with translations

I have example.com which I translated all of the pages in my domain to several languages, all on their own subdomain (e.g. es.example.com, cn.example.com, ru.example.com, etc.). The top level domain ...
2
votes
2answers
39 views

Google Webmaster Tools don't find sitemap.xml

I have a domain which I use in combination with GitHub Pages for my homepage. I have a sitemap.xml, which I submitted to Google Webmaster Tools. Unfortunately I get this error message: Redirection ...
0
votes
0answers
23 views

Mobile Sitemap - Error 404 - WMT dont index it?

I have a site that is not responsive , It has 3 versions : pc tablet and mobile, every version has different pages . I have made 2 sitemaps one for the pc version and one for the mobile version. the ...
197
votes
19answers
29k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
2
votes
1answer
51 views

Right way to index photos with different formats on website

I am working on a website with a lot of pro photos. So I've decided to create 4 different formats for each photo: *_sm.jpg - thumbnail when you click on a photo you will get a bigger photo in the ...
1
vote
6answers
396 views

The URLs in my XML sitemap not being indexed by Google

I am new to Google SEO and I created a sitemap with 636 URLs. I have tried 3 to 4 ideas that I've found here to get the URL indexed in Google search. We waited and waited for Google to index our ...
0
votes
0answers
12 views

Google not crawling all pages [duplicate]

I have over 200,000 pages but only about 23,000 pages are crawled by Google as is evident when i search for site:mywebsite.com and the result comes as About 22,900 results (0.18 seconds) I have over ...
0
votes
0answers
32 views

URLs not allowed error for one property, but not for the other?

All of our XML sitemaps are located on another domain than the domain they're referring to, for instance: - Sitemaps would be located at sitemap-domain.com/sitemap-1.xml - URLs being referenced in ...
1
vote
1answer
98 views

Sitemaps & <link rel=… for quad-directional websites

I realize there are many similar questions, but I think this consolidates multiple points of confusion. This question follows from the great advice given here. I have a site that has a separate mobile ...
9
votes
3answers
828 views

Can the files robots.txt and sitemap.xml be dynamic through an .htaccess redirect?

I have a multilanguage and multidomain site. It runs through a unique CMS installation (Drupal), so I have a single root directory. So if I have a static robots.txt, there I only can show the files ...
0
votes
0answers
19 views

What to do with my RSS sitemap & PubSubHubbub for fast URL indexation in Google?

I've read on several places, that by using Google PubSubHubbub will get the newest pages posted in RSS feeds ultra fast indexed by Google. So, I have my RSS sitemap with lots of new pages added daily ...
0
votes
1answer
45 views

Best practice for generating sitemap

Some colleagues are looking at building a sitemap for our media (audio/images/video/slides) management website. I'm interested in finding out if there are any known, effective and manageable ways of ...
0
votes
1answer
43 views

Sitemap in different domain and robots.txt crawling

I have the following subdomains: www.example.com api.example.com The subdomain api.example.com is supposed to be invisible to Google. Its robots.txt had a disallow / directive. But I don't want ...
1
vote
1answer
44 views

Image sitemap. Ok to use the ALT text as <image:title>?

Screaming Frog uses the alt text of an image when i create a sitemap of a crawled site and places it in the image sitemap as . Is this correct? Or should the actual image title be used as in the ...
65
votes
5answers
29k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
6
votes
9answers
1k views

Is sitemap really important?

Is the sitemap really important? I ask this because I couldn't see the sitemaps of big websites such as Twitter, Facebook and others... The sitemap should be at "/sitemap.xml", "/sitemap.xml.gz" or ...
1
vote
2answers
96 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
0
votes
0answers
10 views

how to allow my web site to appear on Google & Bing search engines [duplicate]

I have developed an asp.net mvc web application representing our web site. and the web site uses friendly urls such as www.ourcompanynam.com/contact . now i deploy the web site to a Microsoft Hosting ...
0
votes
0answers
20 views

Should Google news and Google sitemap index contains all posts in the site?

I have a big database of 5M post, and I have sitemap index like this but without lastmod, and because of this large number of posts it will be hard if I make and sitemap index contains 100000 sitemap ...
0
votes
1answer
12 views

How to handle Partials in a Sitemap?

Let's say I've got all of my pages laid out like root/page.php combined with root/content/page.php page.php includes: header.php footer.php sometemplate.php menu.php submenu.php /content/page.php ...