Questions tagged [xml-sitemap]

XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

Filter by
Sorted by
Tagged with
0
votes
0answers
24 views

Most of my pages weren't indexed [duplicate]

I've submitted a sitemap (XML) of my Drupal (7) site to Google Webmaster Tools and it says that my sitemap contains 285 pages and that only 87 pages were indexed. There are no errors and no ...
1
vote
2answers
324 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
2
votes
2answers
565 views

Indexed URLs in Google Webmaster Tools are missing after migrating to another framework

I migrated my site last week from an old .aspx framework to a new site hosted via WordPress. The domain name is the same and I am seeing no errors when I test and submit the sitemap via Google ...
0
votes
1answer
148 views

Does PageRank flow to pages that are only listed in the sitemap.xml?

Let's say you have a small website that has a PR of 3. On top of that you have on the domain itself a blog that is not linked to the website. The blog along with its posts are however listed in the ...
3
votes
2answers
393 views

Do all pages have to be added to XML Sitemaps?

I'm planning to add an XML Sitemap to a client's existing website. According to this, it will help define the difference between the root website (aimed at UK) and the US website (aimed at the United ...
2
votes
1answer
4k views

Problem with Google Webmaster Tools Sitemap

I have a WPMU 3.6.1 with Domain Mapping (0.5.4.3) with W3TC (0.9.3) and Google XML Sitemaps (4.0 BETA). I have 4 different sitemaps. sub-1.com/sitemap.xml sub-2.com/sitemap.xml sub-3.com/sitemap....
3
votes
1answer
2k views

Should I change the URLs in the XML sitemap after 301 redirecting them?

I am using 301 redirects for all URLs. Should I change sitemap URLs now? The sitemap currently contains the following URLs: example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html ...
2
votes
1answer
601 views

How is it possible that Google has indexed more URLs than a sitemap contains? [duplicate]

Google has processed my XML sitemaps, and for one of the files, Webmaster Tools claims to have indexed 44,797 links even though that file only contains 4,582 links. Here's a screen cap: I'm not ...
0
votes
1answer
718 views

Sitemaps: rel=“alternate” hreflang=“x” naming

I'm creating a Sitemap for rel="alternate" hreflang="x", but no where in Google's guidelines do they mention how it should be named. Also can we reference it separately in the robots.txt file, or does ...
1
vote
1answer
422 views

Making my domain show up instead of my sitemap.xml in Google search results

If I search Google for a term or my site name, Google returns the URL sitename.com/sitemap.xml on the first or second page of the results. I want the main site to return in the results and not the ...
2
votes
2answers
420 views

404 errors still showing in Webmaster Tools

I've a website with Yola, I've been blogging twice a day for three to four years now and suddenly about a month ago, every blog post URL was being seen by Google as a 404 error. I started off by ...
5
votes
3answers
18k views

Sitemap submission : Do sitemaps need to be resubmitted when they are updated?

In short: Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it ...
2
votes
1answer
1k views

How to auto generate my website sitemap regurlarly (day)?

I have developed website in Zend framework, it's like a blog. I'm worried about posting URL links, as they are not being indexed in Google. However, if I generate sitemap.xml externally, and upload it,...
1
vote
2answers
894 views

Why is this date in my sitemap “invalid” according to Google

My XML sitemap file has <lastmod>2013-07-06T09:39:51-0400</lastmod> formatted with W3C Datetime Format. Google has a warning message in webmaster tools about this for me: Google's help ...
3
votes
2answers
5k views

sitemap.xml file extension, does it have to be .xml?

Do XML sitemap files have to end with the .xml file extension? On the Bigcommerce platform, their XML sitemap file are defined as: http://www.examplesite.com/xmlsitemap.php The sitemap file is all ...
5
votes
4answers
4k views

Do you really need robots.txt and sitemap.xml if I want bot to follow every link? [duplicate]

I wonder if I really need robots.txt/*sitemap.xml* files if I want bots to go through every link on my website without any restrictions? And if I do, what should I write in there?
4
votes
2answers
15k views

Why does my sitemap have a “.gz” extension, and how can I edit it?

An XML sitemap generator plugin for WordPress puts the following strings in my robots.txt file: User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ But other WordPress blogs have lots of ...
4
votes
1answer
85 views

Understanding product search links in sitemaps

I am looking at sitemaps of a few large websites like ebay.com and I noticed that the URLs in the sitemap point to search results rather than the actual product page and I have confirmed that all the ...
4
votes
1answer
2k views

Why important/big sites don't include a sitemap? [closed]

I've been looking at most important sites and none of them have a sitemap.xml defined. My list includes: Amazon Ebay Yahoo Microsoft ... and others But none of them include a sitemap.xml file. Why ...
0
votes
1answer
743 views

Should I add the CDN or the source URL of an image to the XML image sitemap?

I'm creating a WP plugin and I have the source URL for the image and the CDN URL to the image as well that is generated by replacing the host to the CDN host. Which is better, if I add the source URL ...
3
votes
4answers
289 views

How does Google have more results than I have pages?

Our site has about 6500 pages. These are kept up to date in our sitemap.xml. When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
7
votes
3answers
4k views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
0
votes
2answers
107 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
4
votes
1answer
8k views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
8
votes
4answers
3k views

Robots.txt vs Sitemap — Who wins in a Conflict

If I block off the directory /foo in robots.txt, but my xml sitemap contains URLs with /foo, will the URLs in the sitemap get picked up by Google and other search engines? In other words, does the ...
13
votes
2answers
1k views

Should I Include RSS Feed URLs in an XML Sitemap?

Simple question - Should I Include the RSS Feed URLs in my site's XML Sitemap? I am NOT asking whether I should USE an RSS Feed AS an XML sitemap, but rather, should I include the URLs to the ...
1
vote
1answer
212 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
4
votes
2answers
389 views

Impact of blocking site search from googlebot, but listing content pages in sitemap.xml

We have a fairly large site 600k+ unique pages with various unique URLs along with a custom, local search interface for the site. The search interface has sorting and faceting capabilities to allow ...
7
votes
2answers
1k views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
2
votes
1answer
267 views

Google Site Search (commercial) not indexing files in sitemap

I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't being reliably indexed. I wrote a script to generate an XML feed (...
1
vote
4answers
3k views

My Xmap generated sitemap is not being submitted

I m using Joomla Xmap component for creating sitemap. Here is the URL of my Xmap generated Sitemap: http://www.acethehimalaya.com/index.php?option=com_xmap&sitemap=1&view=xml I tried to ...
2
votes
1answer
107 views

Url blocked by robots.txt

I badly stuck on error in webmaster tools. I have created Sitemap and when I try to test it on webmaster tools it showing me this below error: Issue : Url blocked by robots.txt Description : ...
5
votes
5answers
3k views

Is there any benefit to having a link to your website's XML sitemap?

In Google's WebmasterTools, I submitted my site's XML sitemap, which is accessible through www.mysite.com/sitemap. However, no where on the site do I have an actual link that points to this. Is ...
0
votes
3answers
2k views

How to properly remove URL's from Google's index?

On some of our sites, we now have several thousand pages that dilute our website's keyword density. The website is an MVC site with SEO routing. If I submit a new sitemap with say only the 2000 or ...
3
votes
1answer
440 views

The “Total Indexed” is always zero in Google Webmaster Tools despite it showing some of the sitemap is indexed

I'm a newbie in Google Webmaster Tools. I've verified my site, created my sitemap and submitted it to the google webmaster account. But after a week of waiting I've found that 46 out of 250 URLs in ...
6
votes
1answer
337 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
6
votes
3answers
5k views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like this?...
1
vote
2answers
396 views

SiteMap / webmaster / google adsense

Can we apply for Adsense without sending Sitemap to webmaster tools ?
0
votes
2answers
496 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
5
votes
1answer
1k views

Sitemap file getting double compressed

I have a script that generates my XML sitemap and writes it to the file sitemap.xml.gz - i.e. an XML file, compressed with gzip. This file is definitely written correctly as when I download it via FTP ...
2
votes
1answer
66 views

Adding tagged / dynamic pages in sitemap

I've got a blog that's been running for about a year, with about 200 posts, and there should be about 220 pages to index (additional pages for about / contact etc). When I go to crawl the site I get ...
0
votes
1answer
2k views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
73
votes
5answers
30k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
5
votes
2answers
2k views

How often are sitemap.xml checked for updates by crawlers?

How often do crawlers check for updates in submitted sitemap.xml? Every hour, day, week, month, more?
2
votes
1answer
518 views

SEO for a wallpaper site [closed]

I am administering a wallpaper website. It hasn't got much content. Pictures mainly and at the moment my sitemap has 1700 entries that includes all the pages ( download pages for single items also ). ...
5
votes
3answers
5k views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
4
votes
3answers
376 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
1
vote
3answers
205 views

How do I make a free sitemap.xml for a site that is few thousand pages? [duplicate]

Possible Duplicate: Free unlimited-page sitemap generator? Is there a free tool out there that would let me make a free sitemap for about 3k page site? Thanks!
0
votes
1answer
943 views

What is the best practice with KML files when adding geositemap?

I'm not sure how to deal with KML files. Now important particularly in reference to the Google Venice update. My site basically is a guide of many company listings (sort of Yellow Pages). I want each ...
3
votes
2answers
951 views

2 the same page addresses in generated sitemap?

I tried different sitemap generators and they generate 2 data structures refering to the same webpage: On the beginning: <url> <loc>http://pundaquit.republika.pl/</loc> <...