XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

learn more… | top users | synonyms

0
votes
1answer
17 views

Should I add the CDN or the source URL of an image to the XML image sitemap?

I'm creating a WP plugin and I have the source URL for the image and the CDN URL to the image as well that is generated by replacing the host to the CDN host. Which is better, if I add the source URL ...
3
votes
4answers
118 views

How does Google have more results than I have pages?

Our site has about 6500 pages. These are kept up to date in our sitemap.xml. When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
4
votes
1answer
59 views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
0
votes
2answers
36 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
1
vote
1answer
125 views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
5
votes
4answers
191 views

Robots.txt vs Sitemap — Who wins in a Conflict

If I block off the directory /foo in robots.txt, but my xml sitemap contains URLs with /foo, will the URLs in the sitemap get picked up by Google and other search engines? In other words, does the ...
9
votes
2answers
127 views

Should I Include RSS Feed URLs in an XML Sitemap?

Simple question - Should I Include the RSS Feed URLs in my site's XML Sitemap? I am NOT asking whether I should USE an RSS Feed AS an XML sitemap, but rather, should I include the URLs to the ...
1
vote
1answer
74 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
3
votes
2answers
126 views

Impact of blocking site search from googlebot, but listing content pages in sitemap.xml

We have a fairly large site 600k+ unique pages with various unique URLs along with a custom, local search interface for the site. The search interface has sorting and faceting capabilities to allow ...
5
votes
1answer
152 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
1
vote
1answer
76 views

Google Site Search (commercial) not indexing files in sitemap

I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't being reliably indexed. I wrote a script to generate an XML feed ...
1
vote
2answers
49 views

My Xmap generated sitemap is not being submitted

I m using joomla xmap component for creating sitemap. Here the URl of my xmap generated Sitemap: http://www.acethehimalaya.com/index.php?option=com_xmap&sitemap=1&view=xml I tried to submit ...
2
votes
1answer
51 views

Url blocked by robots.txt

I badly stuck on error in webmaster tools. I have created Sitemap and when I try to test it on webmaster tools it showing me this below error: Issue : Url blocked by robots.txt Description : ...
3
votes
5answers
198 views

Is there any benefit to having a link to your website's XML sitemap?

In Google's WebmasterTools, I submitted my site's XML sitemap, which is accessible through www.mysite.com/sitemap. However, no where on the site do I have an actual link that points to this. Is ...
0
votes
3answers
189 views

How to properly remove URL's from Google's index?

On some of our sites, we now have several thousand pages that dilute our website's keyword density. The website is an MVC site with SEO routing. If I submit a new sitemap with say only the 2000 or ...
1
vote
0answers
151 views

The “Total Indexed” is always zero in Google Webmaster Tools

I'm a newbie in Google Webmaster Tools. I've verified my site, created my sitemap and submitted it to the google webmaster account. But after a week of waiting I've found that 46 out of 250 URLs in ...
4
votes
1answer
141 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
3
votes
3answers
449 views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
1
vote
2answers
74 views

SiteMap / webmaster / google adsense

Can we apply for Adsense without sending Sitemap to webmaster tools ?
0
votes
2answers
115 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
2
votes
1answer
192 views

Sitemap file getting double compressed

I have a script that generates my XML sitemap and writes it to the file sitemap.xml.gz - i.e. an XML file, compressed with gzip. This file is definitely written correctly as when I download it via FTP ...
2
votes
1answer
49 views

adding tagged / dynamic pages in sitemap

ive got a blog thats been running for about a year ive made about 200 posts, and there should be about 220 pages to index (additional pages for about / contact ect). When i go to crawl the site i get ...
0
votes
1answer
384 views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
-2
votes
2answers
39 views

I don't know how to set up a sitemap [closed]

I have a pretty nice site, but don't know much about webmaster issues. How do I create a sitemap and submit it to Google? What other very basic things should I be doing with my webmaster tools to ...
53
votes
4answers
28k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
3
votes
2answers
255 views

How often are sitemap.xml checked for updates by crawlers?

How often do crawlers check for updates in submitted sitemap.xml? Every hour, day, week, month, more?
2
votes
1answer
169 views

SEO for a wallpaper site [closed]

I am administering a wallpaper website. It hasn't got much content. Pictures mainly and at the moment my sitemap has 1700 entries that includes all the pages ( download pages for single items also ). ...
1
vote
3answers
425 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
3
votes
3answers
190 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
1
vote
3answers
120 views

How do I make a free sitemap.xml for a site that is few thousand pages? [duplicate]

Possible Duplicate: Free unlimited-page sitemap generator? Is there a free tool out there that would let me make a free sitemap for about 3k page site? Thanks!
0
votes
1answer
476 views

What is the best practice with KML files when adding geositemap?

Im not sure how to deal with kml files. Now important particularly in reference to the Google Venice update. My site basically is a guide of many company listings (sort of Yellow Pages). I want each ...
3
votes
2answers
274 views

2 the same page addresses in generated sitemap?

I tried different sitemap generators and they generate 2 data structures refering to the same webpage: On the beginning: <url> <loc>http://pundaquit.republika.pl/</loc> ...
7
votes
1answer
312 views

Should I ping to Google sitemap-index.xml or only the sitemap file that has been modified?

I have a sitemap-index.xml with 7 files. After updating one of the 7 with new content should I ping Google with the index file or with the updated file? In my index I also use lastmod so Google can ...
4
votes
1answer
98 views

sitemap.xml : shall I put all my URLs including the ones that have “empty result” for a dataset?

Here's my problem: on my website, you can click on all the regions, and the new web page is the result of the search of the region. Thus the result may be empty. Shall I include all those "empty ...
3
votes
2answers
190 views

sitemap.xml for huge online store

I'm running online store with 30,000+ products (having unique urls) which are updated every day. I want google to index my products faster. Now crawler index ~500 pages/day (reports from google ...
3
votes
2answers
552 views

Can a sitemap index file list sitemaps in a different directory?

If I have a sitemap index, can the sitemaps listed in the index be located in a subdirectory, but have links that isn't specific to the subdirectory? I'm trying to avoid having multiple sitemaps in ...
2
votes
6answers
362 views

Sitemap tool fails to find all URLs in my site

I added my url to Google http://www.google.com/addurl.html I added a meta tag with description and keywords I added it in Google web master tools and submit the site map There is no any robots in my ...
2
votes
1answer
381 views

Can a sitemap index file point to sitemaps in another directory?

I am creating multiple sitemaps for a site, and for the sake of organization I would like to put these sitemaps into their own directory (of course the sitemap.xml file will be in the root site ...
1
vote
1answer
92 views

Logo Image in Image Sitemap

Here is my concern. I have the logo image along with the entire header section of the site in an 'included' file. How do I present that image in the image sitemap? Should I give the URL of the ...
4
votes
3answers
673 views

Sitemap to display hash tag links or not?

I am just creating sitemap for my site and wanted to find out if I should include # links for SEO? For Example: www.mydomain.com/#comment1 www.mydomain.com/#comment2 Does this help with SEO or ...
2
votes
3answers
225 views

Why is Google ignoring my pages after a sitemap submit?

I've submitted a Google sitemap with 12 links in, and Google has accepted the links (2 weeks ago) but it insists on only showing 4 out of the 12 pages in the search results. Even when doing a site: ...
1
vote
2answers
94 views

your fresh content on Google

I have actually pretty simple question. Having new sitemap every week and get it indexed immediately. How can I guarantee that the new fresh content will be indexed immediately by Google without ...
2
votes
1answer
123 views

Site.xml with #!, still ok to have bare URL as home page?

I'm trying to get some ajax content on my main page indexed by google. I've implemented the #! url structure for that content and the corresponding piece on the server which renders what users see ...
1
vote
1answer
151 views

Is this Sitemap code correct? [closed]

I'd like to check whether I have any of the code not as it should be in my Sitemap file. Not sure if this is too general a question for here... If it's an ok question, here's the sitemap URL: ...
3
votes
4answers
165 views

WWW in Sitemap URL's

I was under the impression that WWW was deprecated but a lot of the sitemap generators seem to rather i use it. I know that Google doesn't like if i mix the two, IE if the URL of the sitemap is ...
1
vote
2answers
51 views

Which of these url for Feeds for the Sitemap should I use?

Does it matter which of these I add to my Sitemaps file? http://example.com/?feed=rss http://example.com/?feed=rss2 http://example.com/?feed=rdf http://example.com/?feed=atom
1
vote
1answer
103 views

Sitemap file entries for blog and main php site

I'm creating a sitemap manually. It's a PHP site with a WordPress blog. Here's the main site: http://wordfruit.com And here's the blog: http://blog.wordfruit.com Can I put the blog URL in the ...
0
votes
1answer
204 views

Code for sitemap — 'weekly.?

I'm creating a Sitemap manually. If I want to specify a url to be crawled weekly, is this the right code: <url> <loc>http://wordfruit.com/</loc> ...
3
votes
6answers
1k views

How to tell Google that I have changed my website URLs?

I have done major updates to my website, and renamed all my URLs. How can I tell Google that I have renamed these URLs and let Google refresh its index? My website URL: http://www.pndmasr.com/ My ...
149
votes
18answers
21k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...