A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

1
vote
1answer
2k views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
2
votes
1answer
56 views

Paginating sitemaps

My sitemap is huge (200k+ articles), so I want to implement pagination of the sitemap itself. My question is what parameter do most search engines look for in a sitemap pagination? page=... or maybe ...
1
vote
1answer
171 views

Google's webmaster tools saying invalid URL in sitemap

I've recently made some big changes to my site and as a result, have had to change my sitemap. In doing so, I resubmitted my sitemap file only to see 3 errors reading invalid URL's. I'm not sure if ...
4
votes
1answer
146 views

Need I submit sitemap in Webmaster Tools?

I have uploaded my sitemap on server root folder. Do I need it submit it in Google Webmaster Tools?
4
votes
1answer
122 views

Webmaster tools show old URLs are crawled

We renewed our website last year (2012) in December. After that we have put 301 redirection in place for the required pages. We removed some pages in old site when we moved to new site. For example ...
0
votes
1answer
40 views

If my index page has no textual content, should it be present in sitemap?

My index page contains no textual content at all (except some footer links, copyright notice and some stuff in tag). It has, however, big Google's map with some pins attached which lead to articles. ...
7
votes
6answers
218 views

In regards to SEO, is a site map important for a small 3 page website?

In regards to SEO, is a site map important for a small 3 page website? I understand that it is not needed for the convenience of a user visiting the site, but will it help the search engines find it?
1
vote
3answers
57 views

Right canonical pages for encylopedia-style site

I have a website that contains a lot of short (150 word) descriptions of key concepts. The concepts are organised hierarchically so a description of Cheese will be a subsection under the heading "Milk ...
-1
votes
1answer
66 views

What is the process of dynamic sitemap creation? [closed]

I am working on a website which have 12Lack pages, so, I want build dynamic sitemap hence I want to know the process of dynamic sitemap creation. tell me if have another way to create sitemap for such ...
1
vote
1answer
146 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
7
votes
1answer
160 views

Solution for large scale site maps

I'm working on a nationwide retail web site with thousands of categories and product pages and my client wants to move from a single sitemap to multiple sitemaps based on page categorization. Here is ...
1
vote
1answer
283 views

How often does GWT check dynamic sitemaps?

I'm working on a fairly large site, that generates a dynamic sitemap hourly. Now in Google Webmaster Tools the sitemap isn't submitted yet and I'm shying away because I'm afraid that the new content ...
6
votes
1answer
570 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
1
vote
1answer
208 views

How to create and submit multiple sitemaps into categories?

I have a questions. I need to know how to create and submit multiple sitemaps into categories? This is for a big online auction site with a lot of products that needs to be indexed.
0
votes
1answer
99 views

SoLoMo landingpage localized regionalized down to cities and SEO sitemap.xml

I'm working on an SoLoMo (social local mobile) web application. How would you realize the site and the landingpages that they are seo and crawler friendly? Any best-practises out there? I know there ...
2
votes
2answers
519 views

Network unreachable: robots.txt unreachable

I am trying to add a valid sitemap to Google Webmaster. Yet, it says: Network unreachable: robots.txt unreachableWe were unable to crawl your Sitemap because we found a robots.txt file at ...
4
votes
2answers
257 views

Is it possible to find out whether one given page has been indexed?

When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog. Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
6
votes
1answer
102 views

Does Google reprocesses submitted sitemaps from time to time?

Assuming one submits a sitemap for a website in Google Webmaster, does Google reprocess it from time to time? If yes, at which rate?
2
votes
1answer
641 views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
2
votes
3answers
81 views

Same sitemap submitted for .com and .co.uk domain

Not to sure why I did this. But I submitted the same sitemap for our .co.uk and .com domain. Looking to put the .com domain on different hosting and create a new site for international customers ...
2
votes
2answers
311 views

Sitemaps - do I need to submit each sitemap in sitemap_index.xml to Google Webmaster tools?

I am having a Wordpress blog on my CentOS server. There is no sitemap.xml in the root directory but there is sitemap_index.xml file in the root directory which contains the following code: ...
2
votes
2answers
137 views

what's wrong with my sitemap?

Google Webmaster Tools says that my sitemap is in a wrong format. I don't see my mistake, I think I followed every guideline provided by Google. Can someone help me? Inline sitemap below, but in ...
2
votes
2answers
103 views

Blogger still visible after moving to WP; Google Indexing issues after moving from Blogger to WP

I recently migrated from Blogger to Wordpress and am having two major transition issues that are really hurting. Despite literally hours of searching and experimenting, I cannot resolve the following: ...
0
votes
1answer
115 views

403 Error Crawling Pages

I am receiving more than 6000 errors in Google Webmaster Tools. It is showing "access denied"; can anyone please help me out with resolving this?
3
votes
0answers
38 views

What factors help in getting a site indexed by Google fast? [duplicate]

Possible Duplicate: What are the best ways to increase a site’s position in Google? What should I do to get a site indexed on Google, fast? Taking example of Super User I just did a quick ...
5
votes
2answers
208 views

How frequently does Googlebot fetch sitemaps? Does it depend on PageRank?

How frequently does Google fetch sitemaps? I am now working with a high traffic website that normally has 30 new posts per minute. It currently it provides a sitemap which only includes the 100 ...
0
votes
1answer
167 views

Visual sitemap generater [closed]

I'm looking for a something to visually create a sitemap for one of my websites. Id like something in a tree structure, so I have the hierarchical view of my site. A couple requirements I have ...
2
votes
1answer
68 views

Using Extension:Maintenance to generate sitemap MediaWiki

I'm using MediaWiki 1.19.2. I want to generate a sitemap.xml. Here's the documentation. We have to use a maintenance script to generate the sitemap.xml. So I use the extension Maintenance but I ...
1
vote
0answers
213 views

Powermapper alternatives and Google Analytics? [closed]

What is a good application to map the hierarchical structure of a website and maybe get some Google Analytics action going on? Powermapper is pretty expensive and the trial version didn't seem ...
4
votes
1answer
285 views

MediaWiki sitemap generator

I'm using mediawiki for my site. I'm trying several ways to generate sitemap but it doesn't work. Anyone knows how to generate sitemap for MediaWiki and alert to Google automatically?
3
votes
3answers
133 views

SEO consideration for duplicate sites

I am building a brochure-ware website for a company that sells products all across the world. They need the site to ask the user what region they are in before using the site; there are 5 regions. ...
0
votes
1answer
207 views

mod_rewrite and SEO friendliness

My website has an atypical structure and I'm not sure if this could create problems in the long run, specially for SEO positioning purposes. I have a unique, large PHP script, and I use the Apache ...
0
votes
2answers
919 views

Only 10% of my site are indexed [duplicate]

I'm newbie in Google Webmaster Tools and I use sitemap.xml to submit urls. The problem is that I've submitted 150 urls and only 17 are indexed! Is that a problem or they will be indexed later?
3
votes
1answer
118 views

Google is not indexing my entire site despite having a sitemap

I have an e-commerce website www.beyondtime.in. I have been constantly monitoring Googlebot crawling on my website and my webmaster account. Lately, I have found two issues that I have not been able ...
0
votes
2answers
91 views

Which kind of public sitemap should I build for a search based navigation site

I have a search based navigation web-site. Each query has filters as well as sort-by. The search results point to end-pages inside the site. Each of those pages has many outlinks to other end-pages. ...
0
votes
1answer
75 views

Trade off: Lower the number of URLs in sitemap from 43k to 23k or update the sitemap.xml only weekly basis

we rewrote the sitemap creation process. Now the sitemap contains 43.000 URLs. 20k more than before. We have daily changing in URLs. The script that is creating the complete sitemap takes more than ...
6
votes
1answer
192 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
3
votes
1answer
105 views

Handling SEO for Infinite pages that cause external slow API calls

I have an 'infinite' amount of pages in my site which rely on an external API. Generating each page takes time (1 minute). Links in the site point to such pages, and when a users clicks them they are ...
1
vote
1answer
94 views

browse-able hierarchy vs. sitemap

The current site navigation is done through a search form. UX wise, I feel it's the best solution we can currently offer our uses. Because this is the case, I have a sitemap that covers all the pages ...
2
votes
1answer
161 views

Low number of site map links and none of mobile site map links indexed in the google

There 2,521 sitemap URLs submit to the Google webmaster tools. But they indexed only 548 URLs and 1,256 mobile sitemap URLs were submitted but none of it indexed. This shown in whole last month. URLs ...
5
votes
1answer
778 views

SEO: Make hashtag links look static

So I have a website which displays all my content vertically. (like modern websites often do these days). Thus I can't create static links to each section. I'm currently handling the scrolling with ...
3
votes
2answers
114 views

Which tool to create a sitemap to plan a future site?

I'd like to create a sitemap to plan a future site, and I'm looking for a tool to do it. I'd like to create a list of all articles first. Then a hierachy. Then I'd like to put the articles on ...
1
vote
1answer
175 views

How do I remove these errors from my blog so as to get adsense approved?

This is the question I asked on SO site earlier, but didn't get satisfactory replies. hoping to find a solution here.. ...
1
vote
2answers
94 views

sitemap for non-CMS based website

I've just finished a new version of my website but now I don't know how to generate a correct sitemap. Now the website is based on PHP files and folder and in blog folder there is Wordpress. This is ...
4
votes
1answer
976 views

Flat vs. Hierarchical Tree Structure

I'm a developer in the middle of the development of a medium-sized website. A requirement that we just received from the resident SEO person on the project is for all the URLs on the site be just off ...
5
votes
3answers
1k views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
0
votes
1answer
341 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
1
vote
2answers
603 views

Why does google crawl my page only once even I set changefreq:daily?

I have built a new site, submitted my homepage URL to Google, and my sitemap(I have about 6,300 pages.). Now when I type site:mydomain.com, there have 1,992 pages have crawled. But they were all ...
0
votes
2answers
186 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
4
votes
1answer
338 views

Determining which sitemap entries not indexed by google

We submit a sitemap to google and can see this being indexed in webmaster tools. We have 5140 entries, and have broken this up to 10 child site maps of 500 each. This all seems to be working well. ...