A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.
149
votes
18answers
21k views
The Sitemap Paradox
We use a sitemap on Stack Overflow, but I have mixed feelings about it.
Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
5
votes
6answers
308 views
Looking for a sitemap generator
I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there ...
4
votes
2answers
1k views
Google doesn't seem to update the description or title of my homepage
Before we launched our website, we had set up a "coming soon" page and google picked up the title and description from its contents. So the description in the search results said, "Coming soon! Visit ...
3
votes
6answers
1k views
How to tell Google that I have changed my website URLs?
I have done major updates to my website, and renamed all my URLs.
How can I tell Google that I have renamed these URLs and let Google refresh its index?
My website URL: http://www.pndmasr.com/
My ...
7
votes
2answers
337 views
Dynamic sitemap file
Does it matter if I serve sitemap.xml as a dynamic page? e.g., use .htaccess to rewrite sitemap.xml (or whatever static URL I submitted at the Webmaster Tools) to a PHP file. The PHP file will call ...
53
votes
4answers
28k views
Are there any clear indicators that my sitemap file is beneficial?
I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site.
Now my question is:
...
3
votes
3answers
2k views
Google Webmaster Tools says my XML sitemap “appears to be an HTML page”
We're running a lot of sites and we've started to get a lot of these errors in Webmaster Tools:
Sitemap is HTML
Your Sitemap appears to be an HTML page. Please use a supported sitemap format ...
2
votes
2answers
895 views
Free unlimited-page sitemap generator? [duplicate]
Possible Duplicate:
Looking for a sitemap generator
I have been using www.xml-sitemaps.com/ but their limit is 500 pages. My site has grown beyond that and I am wondering whether there is ...
6
votes
4answers
169 views
Sitemaps HTML and others
I am looking for the best resources on how to build sitemaps.
I am currently aware of the obvious HTML sitemaps and the (google) sitemap.xml and (yahoo) urllist.txt
Anyone know of resources for ...
3
votes
2answers
333 views
sitemap that contains millions of links/URLs
I am currently working on a shopping / auction website. The involving party who's doing SEO consultancy is insisting to generate URLs for every single combination of products listed on the website, ...
1
vote
3answers
591 views
Where can I find a list of search engine crawler user agents and their domain names?
I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
5
votes
1answer
153 views
Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?
Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)?
I realize that in the XML format I can set priority and ...
5
votes
1answer
1k views
How long does Bingbot typically take to process a sitemap submission?
I submitted a domain's sitemap.xml to Bingbot (in Webmaster Tools).
It's been a couple of days but the status is still pending. Does anyone know how much time does Bing Webmaster Tools takes to ...
4
votes
3answers
674 views
Sitemap to display hash tag links or not?
I am just creating sitemap for my site and wanted to find out if I should include # links for SEO?
For Example:
www.mydomain.com/#comment1
www.mydomain.com/#comment2
Does this help with SEO or ...
3
votes
2answers
153 views
Is it possible to find out whether one given page has been indexed?
When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog.
Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
3
votes
1answer
869 views
Is it necessary to re-submit modified sitemaps?
Assuming a sitemap.xml has been registered properly to major players, do these players come and revisit those sitemap.xml from time to time to check for updates and modifications (say new entries are ...
3
votes
2answers
556 views
Can a sitemap index file list sitemaps in a different directory?
If I have a sitemap index, can the sitemaps listed in the index be located in a subdirectory, but have links that isn't specific to the subdirectory? I'm trying to avoid having multiple sitemaps in ...
2
votes
6answers
364 views
Sitemap tool fails to find all URLs in my site
I added my url to Google http://www.google.com/addurl.html
I added a meta tag with description and keywords
I added it in Google web master tools and submit the site map
There is no any robots in my ...
2
votes
1answer
335 views
Unlimited free sitemap generator for Nginx? [duplicate]
Possible Duplicate:
Looking for a sitemap generator
Google has listed a couple of SMGs but I don't want to try every single one to find the best. Google's own Sitemap Generator is released ...
1
vote
3answers
48 views
Right canonical pages for encylopedia-style site
I have a website that contains a lot of short (150 word) descriptions of key concepts. The concepts are organised hierarchically so a description of Cheese will be a subsection under the heading "Milk ...
1
vote
1answer
45 views
Sitemap creators not visiting most pages
I am trying to generate a sitemap for a customers website, http://www.ruralmarketing.co.nz . When I use the online generators it only ever creates a sitemap with two urls, the index and contact page. ...
0
votes
1answer
229 views
When does Google Webmaster Tools re-evaluate re-submitted sitemaps?
When I alter and re-submit a sitemap does GWTs immediately re-evaluate it or do I have to wait 'til GoogleBot crawls our site again?
I just re-submitted a problematic sitemap and it now displays ...
