A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

2
votes
1answer
167 views

Validating sitemap with Yahoo Explorer

I have a sitemap index on my website, which I successfully validated with "Google webmasters tools". The declarations at the top are: <sitemapindex ...
2
votes
3answers
1k views

Where can I find a list of search engine crawler user agents and their domain names?

I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
2
votes
3answers
505 views

Priority of tags vs posts in a sitemap.xml file

I have a content based website and I'm in the process of creating a sitemap.xml file. I was wondering if it would be best to give high priority to tag urls or to post urls. Has anyone experimented ...
2
votes
1answer
40 views

WordPress and MediaWiki sitemap

I'm planning to make a WordPress site and include, also, a wiki, using MediaWiki. I know how to generate WP and MW sitemaps. Anyway, I think I need to merge the two sitemaps in some way. Am I right? ...
2
votes
1answer
1k views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
1
vote
1answer
1k views

ampersand (&) sign in sitemap generating error

I have ampersand sign in urls and Google is not able to parse my sitemap.xml due to this. I can't remove the sign but i have to submit my xml to google. Is there any solution for this.
1
vote
2answers
260 views

sitemap and crawler

I am still newbie in the entire world of SEO. Let's take a look at my example. I have a website very similar to blog style site. There few patterns for urls, all of the are very simple and allowed to ...
1
vote
3answers
897 views

Does anyone have statistics on percentage of people that use search feature on a website as opposed to the navigation bar

I was interested in knowing percentage of people that use search feature on a website as opposed to the navigation bar. Has search bar become more powerful than the traditional navigation bar for ...
1
vote
3answers
642 views

YAHOO and BING support for Index, Image and Mobile sitemaps

I know Google webmaster supports submitting Image, mobile, video and other types of sitemaps. YAHOO also mentions about mobile site map here. But does it support Image and video sitemaps. I could not ...
1
vote
1answer
675 views

Using Dynamic URLs with more than one Variable in a Sitemap?

I have a site map with generated dynamic urls that I need included in the sitemap. However, the sitemap seems to be generating an error on the & character, so that pages with more than one ...
1
vote
2answers
52 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
3answers
8k views

Sitemap submission : Do sitemaps need to be resubmitted when they are updated?

In short: Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it ...
1
vote
2answers
994 views

multiple urls serving same content - how to handle better?

Urls go like domain/approved/education/kids/female but I also have filter page in place that lets you do this domain/approved/education-entertainment-business/kids/female and so on which means ...
1
vote
2answers
363 views

Validating sitemaps with images tag

I am trying to add the <image> tag to my sitemap, but even trying to look at the XSD , as mentioned by Google at http://www.google.com/support/webmasters/bin/answer.py?answer=183668 , I get 404 ...
1
vote
6answers
389 views

The URLs in my XML sitemap not being indexed by Google

I am new to Google SEO and I created a sitemap with 636 URLs. I have tried 3 to 4 ideas that I've found here to get the URL indexed in Google search. We waited and waited for Google to index our ...
1
vote
2answers
96 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
1
vote
3answers
59 views

Right canonical pages for encylopedia-style site

I have a website that contains a lot of short (150 word) descriptions of key concepts. The concepts are organised hierarchically so a description of Cheese will be a subsection under the heading "Milk ...
1
vote
1answer
524 views

Google Sitemap Limits?

I've read in multiple places that Google's sitemap limits sits at 50,000 URLs per sitemap - though it's my understanding that you can submit multiple sitemaps to overcome this problem. I've also ...
1
vote
3answers
188 views

How do I make a free sitemap.xml for a site that is few thousand pages? [duplicate]

Possible Duplicate: Free unlimited-page sitemap generator? Is there a free tool out there that would let me make a free sitemap for about 3k page site? Thanks!
1
vote
2answers
1k views

Huge drop in indexed pages [duplicate]

Possible Duplicate: Why the # of indexed pages got dicreased? My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
1answer
324 views

Sitemap vs nofollow

I have a sitemap on my site, which includes all users from the site. On the user profile page, tho, I don't want google to index all users, only those with more than 10 posts, so I've added a meta ...
1
vote
2answers
237 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
1
vote
1answer
39 views

Removing items from a sitemap

I'm having a problem removing some unwanted links from my sitemap. The hierarchy which we have in the sitemap is incorrect. I don't want that be like that. Is there any way which I can change it? ...
1
vote
1answer
332 views

change sitemap after 301 redirect

when i use of 301 redirect for all URLs ... should i change sitemap URLs ??? ...... if Sitemap contains following URLs example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html should i ...
1
vote
2answers
408 views

Sitemap indexed count and Google results difference

My sitemap claims they have indexed over 3 thousand pages from it but when i do a site command in Google site:http://domain.com It returns 200 pages. I have heard of the sitemap index count ...
1
vote
1answer
206 views

How do I remove these errors from my blog so as to get adsense approved?

This is the question I asked on SO site earlier, but didn't get satisfactory replies. hoping to find a solution here.. ...
1
vote
2answers
59 views

Which of these url for Feeds for the Sitemap should I use?

Does it matter which of these I add to my Sitemaps file? http://example.com/?feed=rss http://example.com/?feed=rss2 http://example.com/?feed=rdf http://example.com/?feed=atom
1
vote
3answers
334 views

xml sitemap structure

I have been arguing a point and would like a second opinion. The basic point of contention is as follows: We have a site X with a sitemap index file located at: http://www.x.co.uk/sitemap.xml ...
1
vote
1answer
1k views

is it ok to have 2 sitemaps on 1 website?

Do I have to have a sitemap page on my index page for bots to read it or can I just have it anywhere on my server? I have a phpbb/wordpress integration and I need 2 sitemaps mods for each one (or I ...
1
vote
2answers
428 views

How can I allow robots access to my sitemap, but prevent casual users from accessing it?

I am storing my sitemaps in my web folder. I want web crawlers (Googlebot etc) to be able to access the file, but I don't necessarily want all and sundry to have access to it. For example, this site ...
1
vote
1answer
49 views

What are the different types of XML sitemaps that can be submitted to search engines?

I recently came to know about Image sitemaps. Can someone list ALL possible types of sitemaps currently used for listing entire website to search engines?
1
vote
4answers
374 views

Sitemaps - one per subdomain or one for the base domain?

I have more than 5 subdomains on a project, say developer, www, staff and some more, what is the best practice in creating sitemaps? All subdomains that share a same sitemap at base domain ...
1
vote
1answer
223 views

How to tell crawler my sitemaps in a zip file?

I have 2 big sitemaps (map1.xml, map2.xml) and I have a index file (indexmap.xml) that contains the locations of these 2 files. I zip these 3 files to mymaps.zip. In Google Webmaster Tools, should I ...
1
vote
1answer
317 views

Why is there a discrepancy between Index Status and indexed from Sitemaps in Google Webmaster Tools?

I've submitted a sitemap to GWT and things are starting to index as shown under the Crawl → Sitemaps menu. I've also confirmed indexing by doing a Google "site:" search. However going to the ...
1
vote
2answers
197 views

How do I replace all my XML Sitemaps without hurting SEO?

I am looking for someone to tell me the appropriate procedure to replace all Google sitemaps. I can clearly go in and delete the old ones and simply replace them, but as it can sometimes take many ...
1
vote
1answer
61 views

Should I submit XML sitmaps directly or list them in my robots.txt?

Are there advantages to listing XML sitemap files in robots.txt vs submitting them directly to Google via Webmaster Tools?
1
vote
1answer
48 views

Should a URL shortener service provide XML sitemap entries for shortened URLs?

As a fun project I've written my own URL shortening service. I'd like to know if it makes sense / be useful to include the shortened URLs in the generated XML sitemap. At the moment I'm leaning ...
1
vote
1answer
126 views

Should I have a separate sitemap for mobile pages and include that in my robots.txt?

I am working on site that has 20 mobile-friendly pages which are located under a /mobile directory. Should I have a separate sitemap for these mobile pages and include both this and the desktop ...
1
vote
1answer
184 views

Google not index my hosted-blog after adding custom domain

I started a blog since 1 year ago . And my blog was perfectly appearing on google search . But , some days ago , i have set up a custom domain with godaddy . and then submit my new site and a fresh ...
1
vote
1answer
114 views

Does the number of times the sitemap has been updated affect SEO positively?

Does the number of sitemaps on Webmaster Tools affect the Google ranking at all? My website contains two different feeds of constant weekly updates and was wondering whether I should consider ...
1
vote
3answers
507 views

Can canonical tags be placed in the sitemap rather than in each page?

We have canonical tags spread across our web pages. Is it possible to add the canonical tags in our sitemap instead? If yes, how?
1
vote
1answer
109 views

Can I submit duplicate image, video, and content sitemaps to Google Webmaster Tools?

Can I submit 3 duplicate sitemaps (image, video, content) which have same URLs to Google Webmaster Tools? Image Sitemap 1: <loc>http://mywebsite.com/article1</loc> <video:video> ...
1
vote
1answer
41 views

Can I use sitemap index for media RSS (mRrss) files?

I have a lot of mRSS (media Rss) files. I plan to create sitemap index to contain them. Are sitemaps allowed to contain mRss files? To my knowledge, they are only allowed to contain image, video, ...
1
vote
1answer
107 views

changing URL format afftects SEO reputation and not considering 301 redirection

We had URL http://www.example.com/category/subcategory.html which changed to http://www.example.com/category/filter/cat/subcategory.html We did 301 redirection, updated canonical URL to new one also ...
1
vote
2answers
313 views

Need to encourage google to refresh robots.txt [duplicate]

My old robots.txt is User-agent: * Disallow: / Is blocking me for uploading a new sitemap and also blocking me for fetching robots.txt manually. I don't know what to do.
1
vote
2answers
75 views

HTML Sitemap URL format

When adding a html sitemap to a site, for SEO purposes should the links it contains be locally referenced or is it better to use the full URL? Eg: <ul> <li><a ...
1
vote
2answers
73 views

Should I use a video sitemap when my video URLs change every two hours to prevent hotlinking?

I have over 10k videos hosted on my server, and I'm using lighttpd to switch the video URLs every 2 hours because of hotlinking protection. This means that all video URLs in video sitemap is only ...
1
vote
1answer
78 views

Why I see my page sitemap XML link in Google?

I am using Yoast SEO plugin for my WordPress website. I am also using Yoast's XML Sitemap. Today I checked my pages in Google and found this indexed by Google: Title: http://example.com/ ...
1
vote
1answer
494 views

Flat vs. Hierarchical Tree Structure (vol. 2)

This relevant question deals with whether a site URL structure is better (SEO-wise) to be flat or hierarchical. How much important is it for a site ranking if the overall structure is flat or ...
1
vote
3answers
92 views

Is it necessary to link to all landing pages from the homepage?

What I am wanting to do is build quite a few landing pages targeting specific keywords from google search. These pages will give a brief explanation of what we do and how we can help them with what ...