A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
2
votes
2answers
140 views
Sitemaps index submission
I have two questions regarding site maps:
1) Currently my site has around 5,000 pages. However, in the future it will contain more than 50,000 pages. Should I start using sitemap-index with only one ...
5
votes
1answer
432 views
Sitemap XML version vs simple text (urls list) version, do you know what are the pros?
I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :)
...
1
vote
1answer
82 views
What are Sitemap content tags?
i have recently generated sitemap for google.
I included following loc, lastmod, changefreq. My site is in two languages. Do i need to add some other tags for specifying languages too
3
votes
3answers
133 views
How do you figure out a large site link/structure?
Suppose you're re-designing an existing large site. The first thing to do is to figure out how the site is structured, how many links, pages, sub domains, etc.
Is there a tool you can use to crawl a ...
149
votes
18answers
21k views
The Sitemap Paradox
We use a sitemap on Stack Overflow, but I have mixed feelings about it.
Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
4
votes
3answers
128 views
My archives are beating my current content, how do I stop from competing against myself?
I've inherited a site with about 15,000 pages going back 16 years. Often current events are outranked by previous events. What are the best techniques to make sure that I'm not fighting against ...
17
votes
6answers
4k views
Why did Google stop indexing pages from our sitemap.xml?
We're seeing some pages that exist in our sitemap.xml but are inexplicably missing from Google's public search index.
You can't download http://superuser.com/sitemap.xml -- we protect this file ...
5
votes
6answers
308 views
Looking for a sitemap generator
I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there ...
7
votes
4answers
1k views
& in sitemap links, are they correct?
Simple question, I'm asking just to make sure.
A Google sitemap generator generated a sitemap.txt fle with links written like this:
http://www.domain.com/category.htm?name=some-name&cat_id=8
...
9
votes
1answer
234 views
using multiple sitemaps in a domain
I have a domain http://sub.example.com/.
In it there is a wordpress blog at http://sub.example.com/blog and other more static content at http://sub.example.com/other, http://sub.example.com/stuff, ...
5
votes
2answers
607 views
Does sitemap.xml contain links to the entire site?
I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
1
vote
3answers
591 views
Where can I find a list of search engine crawler user agents and their domain names?
I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
13
votes
4answers
331 views
easy tool for creating XML sitemaps? (constantly expanding site)
Does anyone recommend either
a php script that I can run as a CRON
or
somekind of thirdparty tool i can use
to create sitemaps?
My website is events bases and so the pages are pretty ...
4
votes
2answers
141 views
Looking for ideas for a site map page on the website
We have a site with a lot of pages. We are in some of the final stages of redesigning the site and am looking for some examples of good site map designs we can be inspired by.
Have you seen any good ...
2
votes
3answers
257 views
Priority of tags vs posts in a sitemap.xml file
I have a content based website and I'm in the process of creating a sitemap.xml file. I was wondering if it would be best to give high priority to tag urls or to post urls. Has anyone experimented ...
1
vote
1answer
479 views
Using Dynamic URLs with more than one Variable in a Sitemap?
I have a site map with generated dynamic urls that I need included in the sitemap. However, the sitemap seems to be generating an error on the & character, so that pages with more than one ...
12
votes
1answer
1k views
Should I include everything in the sitemap or only new content?
For a website with dynamic content (new content is constantly being added), should I only include the newest content in the sitemap or should I include everything (with a sitemap index)? What are the ...
3
votes
3answers
430 views
How do I specify the Google sitemap generator destination directory
Is there a way to specify the location of generated sitemap files using the lastest version of the Google Sitemap Generator?
Version is: 1.0.0.0? (a very un-google version number, lol):
> sudo ...
1
vote
1answer
220 views
How can I allow robots access to my sitemap, but prevent casual users from accessing it?
I am storing my sitemaps in my web folder. I want web crawlers (Googlebot etc) to be able to access the file, but I dont necessarily want all and sundry to have access to it.
For example, this site ...
11
votes
3answers
2k views
How to create a good sitemap for dynamic website
I have a website with dynamic content and different kind of pages. I have some pages that rarely change, and I have pages like blogs that change often. The blog pages also have links for sorting, for ...
11
votes
5answers
518 views
Is it necessary/useful to build a sitemap for a small website?
I've created several small scale websites, usually for small businesses. They usually contain some information about the company, a contact form, and sometimes a few dynamic parts : news, pictures, ...
3
votes
2answers
335 views
Is there a way to add embedded youtube videos to my website sitemap?
The goal is to make embedded youtube videos appear in video search results as part of my website.
I searched very extensively how to do this; I found through google some articles that claim that it's ...
6
votes
4answers
169 views
Sitemaps HTML and others
I am looking for the best resources on how to build sitemaps.
I am currently aware of the obvious HTML sitemaps and the (google) sitemap.xml and (yahoo) urllist.txt
Anyone know of resources for ...
11
votes
1answer
366 views
Proper sitemap.xml setup
I have a dynamic site which has many (well, less than 50) users. Each user is allowed to create as many pages as they want. I know that there is a limit to how many pages you can be listed in ...
2
votes
4answers
125 views
How are the sitemaps of big sites generated?
The question is related to my questions about things the filesystem of Wikipedia and generating sitemap for Wikipedia. It is more general.
Problem: Suppose a site on MediaWiki with about 10,000 ...
4
votes
3answers
770 views
How long does it take for Google Webmasters to index site after submitting sitemap? [duplicate]
Possible Duplicate:
Why isn't my website in Google search results?
I have submitted my website today into Google search using Google Webmasters using sitemaps.
The status on the ...
