A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

2
votes
2answers
42 views

Should we include images in sitemap to index?

The sitemap of my website is currently indexing only posts and pages. It is not indexing the media content that is images and attachments. Is it a good idea not to submit images for indexing. If not ...
2
votes
1answer
46 views

URL in sitemap with temporary/dynamic noindex

Our scenario is we've got multiple pages set up for category-based browsing, such as example.com/products/boardgames A list of the canonical URLs for the categories is in the sitemap, with a frequency ...
2
votes
1answer
55 views

Right way to index photos with different formats on website

I am working on a website with a lot of pro photos. So I've decided to create 4 different formats for each photo: *_sm.jpg - thumbnail when you click on a photo you will get a bigger photo in the ...
2
votes
1answer
113 views

hreflang tags in sitemaps - your site has no hreflang tags

We are using hreflang tags in our sitemaps and we're currently experiencing a number of issues with errors in WMT suggesting 'no return tags' and 'your site has no hreflang tags' that don't seem ...
2
votes
1answer
12 views

How would search engines notify us about errors with live sitemaps?

We have been asked to generate sitemaps to assist robots indexing our site because we generate content dynamically. So far, we can create those maps just fine and they seem to pass XML validators just ...
2
votes
1answer
71 views

Correctly handling multi language URL's in sitemaps

I have an English page: https://www.example.com/content/article-1 This page is also avaliable in other languages at the URLs: https://www.example.com/de/content/article-1 ...
2
votes
1answer
134 views

Google Webmaster Tools complains about invalid namespace in my sitemap

I'm having trouble defining my sitemap to Google's liking. I'm having a hard time testing this, because I can only test the validity of our sitemap using Google Webmaster Tools, when the newest code ...
2
votes
1answer
51 views

Sitemap submission for blogger blogspot

Should I submit my XML sitemap using robots.txt or using Google Webmaster Tools? Is only robots.txt submission is enough?
2
votes
1answer
561 views

Should a responsive site include <mobile:mobile/> in its sitemap?

Should a website built with responsive design include Google's <mobile:mobile/> xml tag in its sitemap.xml? In other words, will marking each of my urls as "mobile" in the sitemap for a ...
2
votes
1answer
80 views

Do image tags in sitemaps count towards the sitemap size limit?

I am working on adding the image:url tags inside the loc tag in our sitemaps. The documentation from Google says I can include up to 1000, image:url inside a loc tag. There is no mention if this 1000 ...
2
votes
1answer
660 views

Can externally hosted sitemaps work with Google and Bing?

I am using a "cloud" hosting provider (Heroku) to host my webapp. Since I don't have access to a permanent file system, I am storing my sitemap.xml in Amazon S3. I wanted to know the SEO implications ...
2
votes
1answer
65 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
2
votes
1answer
1k views

What is the correct format and attributes for adding a PDF to an XML sitemap?

I have found numerous questions and blogs about including PDF files in an XML sitemap but cannot find a single one that gives a working example or which attributes to use: What document types can be ...
2
votes
1answer
880 views

How to auto generate my website sitemap regurlarly (day)?

I have developed website in Zend framework, it's like a blog. I'm worried about posting URL links, as they are not being indexed in Google. However, if I generate sitemap.xml externally, and upload ...
2
votes
3answers
103 views

Same sitemap submitted for .com and .co.uk domain

Not to sure why I did this. But I submitted the same sitemap for our .co.uk and .com domain. Looking to put the .com domain on different hosting and create a new site for international customers ...
2
votes
1answer
318 views

Low number of site map links and none of mobile site map links indexed in the google

There 2,521 sitemap URLs submit to the Google webmaster tools. But they indexed only 548 URLs and 1,256 mobile sitemap URLs were submitted but none of it indexed. This shown in whole last month. URLs ...
2
votes
1answer
63 views

Adding tagged / dynamic pages in sitemap

I've got a blog that's been running for about a year, with about 200 posts, and there should be about 220 pages to index (additional pages for about / contact etc). When I go to crawl the site I get ...
2
votes
2answers
245 views

Why google doesn't index youtube videos in sitemap?

I've created a sitemap for youtube hosted videos in my website. you can find it here. http://www.informaincasa.it/wp-content/uploads/sitemap-video.xml I've also created a sitemap for videos hosted on ...
2
votes
2answers
85 views

What are sitemap letters? sitemap-g.xml sitemap-r.xml sitemap-b.xml

I have a sitemap on my site at this location: https://www.loveelectronics.co.uk/handlers/sitemap.ashx which is referenced in my robots.txt like so: Sitemap: ...
2
votes
1answer
203 views

Sitemap contains a lot of products and web index contains a few according to Google webmaster tools

Our sitemap has something like 10 million pages: This is the data in the webmaster tools: Submitted URLs 10,873,781 2 URLs in web index. This is a big difference and an incorrect statement, since ...
2
votes
1answer
168 views

Validating sitemap with Yahoo Explorer

I have a sitemap index on my website, which I successfully validated with "Google webmasters tools". The declarations at the top are: <sitemapindex ...
2
votes
3answers
1k views

Where can I find a list of search engine crawler user agents and their domain names?

I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
2
votes
3answers
534 views

Priority of tags vs posts in a sitemap.xml file

I have a content based website and I'm in the process of creating a sitemap.xml file. I was wondering if it would be best to give high priority to tag urls or to post urls. Has anyone experimented ...
2
votes
0answers
23 views

Which is faster for sitemap submission: ping or submit via search console?

Previously I asked a question about marking sitemap warnings as fixed here: Resetting sitemap warnings in Webmaster Tools I look in my account today and find such warnings and errors are always ...
2
votes
0answers
25 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - ...
2
votes
0answers
44 views

Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything. Here is my AVS tube robots.txt: User-agent: * Allow: / Disallow: ...
2
votes
1answer
220 views

Does the load time of an XML sitemap matter?

I have a dynamic sitemap that will change on a daily basis. Because I'm hosting on Heroku, I'm having some difficulty getting it to persist. I'm considering having the sitemap generate on request, ...
2
votes
1answer
40 views

WordPress and MediaWiki sitemap

I'm planning to make a WordPress site and include, also, a wiki, using MediaWiki. I know how to generate WP and MW sitemaps. Anyway, I think I need to merge the two sitemaps in some way. Am I right? ...
2
votes
1answer
1k views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
1
vote
1answer
1k views

ampersand (&) sign in sitemap generating error

I have ampersand sign in urls and Google is not able to parse my sitemap.xml due to this. I can't remove the sign but i have to submit my xml to google. Is there any solution for this.
1
vote
2answers
263 views

sitemap and crawler

I am still newbie in the entire world of SEO. Let's take a look at my example. I have a website very similar to blog style site. There few patterns for urls, all of the are very simple and allowed to ...
1
vote
3answers
926 views

Does anyone have statistics on percentage of people that use search feature on a website as opposed to the navigation bar

I was interested in knowing percentage of people that use search feature on a website as opposed to the navigation bar. Has search bar become more powerful than the traditional navigation bar for ...
1
vote
3answers
657 views

YAHOO and BING support for Index, Image and Mobile sitemaps

I know Google webmaster supports submitting Image, mobile, video and other types of sitemaps. YAHOO also mentions about mobile site map here. But does it support Image and video sitemaps. I could not ...
1
vote
1answer
693 views

Using Dynamic URLs with more than one Variable in a Sitemap?

I have a site map with generated dynamic urls that I need included in the sitemap. However, the sitemap seems to be generating an error on the & character, so that pages with more than one ...
1
vote
2answers
54 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
3answers
10k views

Sitemap submission : Do sitemaps need to be resubmitted when they are updated?

In short: Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it ...
1
vote
2answers
1k views

multiple urls serving same content - how to handle better?

Urls go like domain/approved/education/kids/female but I also have filter page in place that lets you do this domain/approved/education-entertainment-business/kids/female and so on which means ...
1
vote
2answers
370 views

Validating sitemaps with images tag

I am trying to add the <image> tag to my sitemap, but even trying to look at the XSD , as mentioned by Google at http://www.google.com/support/webmasters/bin/answer.py?answer=183668 , I get 404 ...
1
vote
6answers
536 views

The URLs in my XML sitemap not being indexed by Google

I am new to Google SEO and I created a sitemap with 636 URLs. I have tried 3 to 4 ideas that I've found here to get the URL indexed in Google search. We waited and waited for Google to index our ...
1
vote
2answers
98 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
1
vote
3answers
61 views

Right canonical pages for encylopedia-style site

I have a website that contains a lot of short (150 word) descriptions of key concepts. The concepts are organised hierarchically so a description of Cheese will be a subsection under the heading "Milk ...
1
vote
1answer
543 views

Google Sitemap Limits?

I've read in multiple places that Google's sitemap limits sits at 50,000 URLs per sitemap - though it's my understanding that you can submit multiple sitemaps to overcome this problem. I've also ...
1
vote
3answers
192 views

How do I make a free sitemap.xml for a site that is few thousand pages? [duplicate]

Possible Duplicate: Free unlimited-page sitemap generator? Is there a free tool out there that would let me make a free sitemap for about 3k page site? Thanks!
1
vote
2answers
1k views

Huge drop in indexed pages [duplicate]

Possible Duplicate: Why the # of indexed pages got dicreased? My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
1answer
328 views

Sitemap vs nofollow

I have a sitemap on my site, which includes all users from the site. On the user profile page, tho, I don't want google to index all users, only those with more than 10 posts, so I've added a meta ...
1
vote
3answers
35 views

Does the sitemap necessarily need to be in the root folder?

I have created a sitemap index and all the additional sitemaps that I want to upload into webmasters tools. Do I need to keep them in the root folder or can I just create a folder called "sitemaps" ...
1
vote
1answer
479 views

Why is there a discrepancy between Index Status and indexed from Sitemaps in Google Webmaster Tools?

I've submitted a sitemap to GWT and things are starting to index as shown under the Crawl → Sitemaps menu. I've also confirmed indexing by doing a Google "site:" search. However going to the ...
1
vote
2answers
246 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
1
vote
1answer
50 views

Removing items from a sitemap

I'm having a problem removing some unwanted links from my sitemap. The hierarchy which we have in the sitemap is incorrect. I don't want that be like that. Is there any way which I can change it? ...
1
vote
2answers
427 views

Sitemap indexed count and Google results difference

My sitemap claims they have indexed over 3 thousand pages from it but when i do a site command in Google site:http://domain.com It returns 200 pages. I have heard of the sitemap index count ...