A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
1answer
105 views

SItemap for site with translations

I have a domain.com which I translated all of the pages in my domain to several languages, all on their own subdomain (e.g. es.domain.com, cn.domain.com, ru.domain.com ...). The top level domain ...
1
vote
2answers
290 views

Validating sitemaps with images tag

I am trying to add the <image> tag to my sitemap, but even trying to look at the XSD , as mentioned by Google at http://www.google.com/support/webmasters/bin/answer.py?answer=183668 , I get 404 ...
8
votes
2answers
374 views

Dynamic sitemap file

Does it matter if I serve sitemap.xml as a dynamic page? e.g., use .htaccess to rewrite sitemap.xml (or whatever static URL I submitted at the Webmaster Tools) to a PHP file. The PHP file will call ...
2
votes
2answers
165 views

Sitemaps index submission

I have two questions regarding site maps: 1) Currently my site has around 5,000 pages. However, in the future it will contain more than 50,000 pages. Should I start using sitemap-index with only one ...
5
votes
1answer
500 views

Sitemap XML version vs simple text (urls list) version, do you know what are the pros?

I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :) ...
1
vote
1answer
86 views

What are Sitemap content tags?

i have recently generated sitemap for google. I included following loc, lastmod, changefreq. My site is in two languages. Do i need to add some other tags for specifying languages too
4
votes
3answers
164 views

How do you figure out a large site link/structure?

Suppose you're re-designing an existing large site. The first thing to do is to figure out how the site is structured, how many links, pages, sub domains, etc. Is there a tool you can use to crawl a ...
168
votes
19answers
25k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
4
votes
3answers
134 views

My archives are beating my current content, how do I stop from competing against myself?

I've inherited a site with about 15,000 pages going back 16 years. Often current events are outranked by previous events. What are the best techniques to make sure that I'm not fighting against ...
17
votes
6answers
4k views

Why did Google stop indexing pages from our sitemap.xml?

We're seeing some pages that exist in our sitemap.xml but are inexplicably missing from Google's public search index. You can't download http://superuser.com/sitemap.xml -- we protect this file ...
5
votes
6answers
387 views

Looking for a sitemap generator

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there ...
9
votes
5answers
2k views

&amp; in sitemap links, are they correct?

Simple question, I'm asking just to make sure. A Google sitemap generator generated a sitemap.txt fle with links written like this: http://www.domain.com/category.htm?name=some-name&amp;cat_id=8 ...
9
votes
1answer
295 views

using multiple sitemaps in a domain

I have a domain http://sub.example.com/. In it there is a wordpress blog at http://sub.example.com/blog and other more static content at http://sub.example.com/other, http://sub.example.com/stuff, ...
5
votes
2answers
846 views

Does sitemap.xml contain links to the entire site?

I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
1
vote
3answers
913 views

Where can I find a list of search engine crawler user agents and their domain names?

I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
13
votes
4answers
358 views

easy tool for creating XML sitemaps? (constantly expanding site)

Does anyone recommend either a php script that I can run as a CRON or somekind of thirdparty tool i can use to create sitemaps? My website is events bases and so the pages are pretty ...
4
votes
2answers
273 views

Looking for ideas for a site map page on the website

We have a site with a lot of pages. We are in some of the final stages of redesigning the site and am looking for some examples of good site map designs we can be inspired by. Have you seen any good ...
2
votes
3answers
349 views

Priority of tags vs posts in a sitemap.xml file

I have a content based website and I'm in the process of creating a sitemap.xml file. I was wondering if it would be best to give high priority to tag urls or to post urls. Has anyone experimented ...
1
vote
1answer
570 views

Using Dynamic URLs with more than one Variable in a Sitemap?

I have a site map with generated dynamic urls that I need included in the sitemap. However, the sitemap seems to be generating an error on the & character, so that pages with more than one ...
13
votes
1answer
1k views

Should I include everything in the sitemap or only new content?

For a website with dynamic content (new content is constantly being added), should I only include the newest content in the sitemap or should I include everything (with a sitemap index)? What are the ...
3
votes
3answers
606 views

How do I specify the Google sitemap generator destination directory

Is there a way to specify the location of generated sitemap files using the lastest version of the Google Sitemap Generator? Version is: 1.0.0.0? (a very un-google version number, lol): > sudo ...
1
vote
2answers
307 views

How can I allow robots access to my sitemap, but prevent casual users from accessing it?

I am storing my sitemaps in my web folder. I want web crawlers (Googlebot etc) to be able to access the file, but I don't necessarily want all and sundry to have access to it. For example, this site ...
11
votes
3answers
2k views

How to create a good sitemap for dynamic website

I have a website with dynamic content and different kind of pages. I have some pages that rarely change, and I have pages like blogs that change often. The blog pages also have links for sorting, for ...
11
votes
6answers
922 views

Is it necessary/useful to build a sitemap for a small website?

I've created several small scale websites, usually for small businesses. They usually contain some information about the company, a contact form, and sometimes a few dynamic parts : news, pictures, ...
3
votes
2answers
349 views

Is there a way to add embedded youtube videos to my website sitemap?

The goal is to make embedded youtube videos appear in video search results as part of my website. I searched very extensively how to do this; I found through google some articles that claim that it's ...
7
votes
4answers
179 views

Sitemaps HTML and others

I am looking for the best resources on how to build sitemaps. I am currently aware of the obvious HTML sitemaps and the (google) sitemap.xml and (yahoo) urllist.txt Anyone know of resources for ...
11
votes
1answer
406 views

Proper sitemap.xml setup

I have a dynamic site which has many (well, less than 50) users. Each user is allowed to create as many pages as they want. I know that there is a limit to how many pages you can be listed in ...
3
votes
4answers
161 views

How are the sitemaps of big sites generated?

The question is related to my questions about things the filesystem of Wikipedia and generating sitemap for Wikipedia. It is more general. Problem: Suppose a site on MediaWiki with about 10,000 ...
4
votes
3answers
2k views

How long does it take for Google Webmasters to index site after submitting sitemap? [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have submitted my website today into Google search using Google Webmasters using sitemaps. The status on the ...