Questions tagged [xml-sitemap]

XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

Filter by
Sorted by
Tagged with
1
vote
1answer
883 views

Sitemap.xml / Update Frequency + Priority 0

I'm working on building sitemaps and am not sure what should and should not be added. For example: https://www.website.com             https://...
5
votes
4answers
9k views

What URLs should I put into XML Sitemap?

We will launch a project with over 1.000.000 products and those are in approx 150 categories. Later on you will find reviews and technical detail pages to those products. So there will be more than 2....
2
votes
3answers
1k views

How to specify priority content for Google to index first when launching a very large website

My team will go online with a portal that will have over 1.000.000 products. And I read here following text: Prioritize which content you have indexed. With that much data, not all of it is going ...
0
votes
3answers
38 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend on ...
2
votes
1answer
10k views

Subdomains as a part of the one site

Let's say that the site consists of some pages like: some_product.example.com some_service.example.com another_product.example.com ...so on Can I work with such a site using Google Webmasters Tools, ...
3
votes
1answer
3k views

What is the correct format and attributes for adding a PDF to an XML sitemap?

I have found numerous questions and blogs about including PDF files in an XML sitemap but cannot find a single one that gives a working example or which attributes to use: What document types can be ...
6
votes
1answer
605 views

If I use the same image on multiple pages, should it be on my sitemap multiple times?

Following Google's guide to Image sitemaps <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/...
2
votes
1answer
159 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
2
votes
3answers
317 views

How to make Google index all sitemap.xml records? [duplicate]

I have a sitemap.xml index fine with 3 XML files in it with around 120 pages for indexing. A year passed and I still have 1/3 of it indexed. All the most important pages for indexing are in 1st ...
1
vote
1answer
83 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
98 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: http://tests.compkerworld.com/...
0
votes
2answers
1k views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
3
votes
3answers
2k views

Generate a sitemap automatically, does it need to be XML?

I want to create an XML sitemap (for the sake of SEO), my first attempt to achieve this was by including the website main menu/navigation links using <?php include ("assets/includes/menu.inc"); ?&...
0
votes
1answer
328 views

How many XML sitemap can generate for one site and is it hammer to SEO ranking?

How many XML sitemap can generate for one site and is it hammer to SEO ranking?
1
vote
1answer
38 views

Track the modification time of files with a regeneratable website

I have a website that is automatically regenerated every day based on a fresh copy of an externally-supplied database, which has no concept of the modification time of the individual records (e.g., ...
1
vote
1answer
450 views

New sitemap isn't being crawled, but the old sitemap is

I am helping on a website, it was redone a few months ago. We have 301 redirection links set, uploaded a new sitemap (with the updated links) and submitted it. But only one page is getting indexed (...
0
votes
1answer
425 views

Sitemap.xml doesn't seem to be working properly [duplicate]

I have a sitemap.xml on one of my domains. It contains the following: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>http://www.domain.com</loc> ...
0
votes
3answers
182 views

Splitting a sitemap by content type

I currently am tasked with submitting our website sitemap to the search engines every week. We have a module which does offer sitemap generation but we find using it does not work very well as not ...
0
votes
0answers
24 views

Most of my pages weren't indexed [duplicate]

I've submitted a sitemap (XML) of my Drupal (7) site to Google Webmaster Tools and it says that my sitemap contains 285 pages and that only 87 pages were indexed. There are no errors and no ...
1
vote
2answers
337 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
2
votes
2answers
566 views

Indexed URLs in Google Webmaster Tools are missing after migrating to another framework

I migrated my site last week from an old .aspx framework to a new site hosted via WordPress. The domain name is the same and I am seeing no errors when I test and submit the sitemap via Google ...
0
votes
1answer
153 views

Does PageRank flow to pages that are only listed in the sitemap.xml?

Let's say you have a small website that has a PR of 3. On top of that you have on the domain itself a blog that is not linked to the website. The blog along with its posts are however listed in the ...
3
votes
2answers
591 views

Do all pages have to be added to XML Sitemaps?

I'm planning to add an XML Sitemap to a client's existing website. According to this, it will help define the difference between the root website (aimed at UK) and the US website (aimed at the United ...
2
votes
1answer
4k views

Problem with Google Webmaster Tools Sitemap

I have a WPMU 3.6.1 with Domain Mapping (0.5.4.3) with W3TC (0.9.3) and Google XML Sitemaps (4.0 BETA). I have 4 different sitemaps. sub-1.com/sitemap.xml sub-2.com/sitemap.xml sub-3.com/sitemap....
3
votes
1answer
2k views

Should I change the URLs in the XML sitemap after 301 redirecting them?

I am using 301 redirects for all URLs. Should I change sitemap URLs now? The sitemap currently contains the following URLs: example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html ...
2
votes
1answer
621 views

How is it possible that Google has indexed more URLs than a sitemap contains? [duplicate]

Google has processed my XML sitemaps, and for one of the files, Webmaster Tools claims to have indexed 44,797 links even though that file only contains 4,582 links. Here's a screen cap: I'm not ...
0
votes
1answer
720 views

Sitemaps: rel=“alternate” hreflang=“x” naming

I'm creating a Sitemap for rel="alternate" hreflang="x", but no where in Google's guidelines do they mention how it should be named. Also can we reference it separately in the robots.txt file, or does ...
1
vote
1answer
423 views

Making my domain show up instead of my sitemap.xml in Google search results

If I search Google for a term or my site name, Google returns the URL sitename.com/sitemap.xml on the first or second page of the results. I want the main site to return in the results and not the ...
1
vote
2answers
435 views

404 errors still showing in Webmaster Tools

I've a website with Yola, I've been blogging twice a day for three to four years now and suddenly about a month ago, every blog post URL was being seen by Google as a 404 error. I started off by ...
5
votes
3answers
19k views

Sitemap submission : Do sitemaps need to be resubmitted when they are updated?

In short: Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it ...
2
votes
1answer
1k views

How to auto generate my website sitemap regurlarly (day)?

I have developed website in Zend framework, it's like a blog. I'm worried about posting URL links, as they are not being indexed in Google. However, if I generate sitemap.xml externally, and upload it,...
1
vote
2answers
1k views

Why is this date in my sitemap “invalid” according to Google

My XML sitemap file has <lastmod>2013-07-06T09:39:51-0400</lastmod> formatted with W3C Datetime Format. Google has a warning message in webmaster tools about this for me: Google's help ...
3
votes
2answers
5k views

sitemap.xml file extension, does it have to be .xml?

Do XML sitemap files have to end with the .xml file extension? On the Bigcommerce platform, their XML sitemap file are defined as: http://www.examplesite.com/xmlsitemap.php The sitemap file is all ...
5
votes
4answers
4k views

Do you really need robots.txt and sitemap.xml if I want bot to follow every link? [duplicate]

I wonder if I really need robots.txt/*sitemap.xml* files if I want bots to go through every link on my website without any restrictions? And if I do, what should I write in there?
4
votes
2answers
16k views

Why does my sitemap have a “.gz” extension, and how can I edit it?

An XML sitemap generator plugin for WordPress puts the following strings in my robots.txt file: User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ But other WordPress blogs have lots of ...
4
votes
1answer
86 views

Understanding product search links in sitemaps

I am looking at sitemaps of a few large websites like ebay.com and I noticed that the URLs in the sitemap point to search results rather than the actual product page and I have confirmed that all the ...
4
votes
1answer
3k views

Why important/big sites don't include a sitemap? [closed]

I've been looking at most important sites and none of them have a sitemap.xml defined. My list includes: Amazon Ebay Yahoo Microsoft ... and others But none of them include a sitemap.xml file. Why ...
0
votes
1answer
824 views

Should I add the CDN or the source URL of an image to the XML image sitemap?

I'm creating a WP plugin and I have the source URL for the image and the CDN URL to the image as well that is generated by replacing the host to the CDN host. Which is better, if I add the source URL ...
3
votes
4answers
291 views

How does Google have more results than I have pages?

Our site has about 6500 pages. These are kept up to date in our sitemap.xml. When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
7
votes
3answers
4k views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
0
votes
2answers
107 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
4
votes
1answer
8k views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
8
votes
4answers
3k views

Robots.txt vs Sitemap — Who wins in a Conflict

If I block off the directory /foo in robots.txt, but my xml sitemap contains URLs with /foo, will the URLs in the sitemap get picked up by Google and other search engines? In other words, does the ...
13
votes
2answers
1k views

Should I Include RSS Feed URLs in an XML Sitemap?

Simple question - Should I Include the RSS Feed URLs in my site's XML Sitemap? I am NOT asking whether I should USE an RSS Feed AS an XML sitemap, but rather, should I include the URLs to the ...
1
vote
1answer
212 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
4
votes
2answers
393 views

Impact of blocking site search from googlebot, but listing content pages in sitemap.xml

We have a fairly large site 600k+ unique pages with various unique URLs along with a custom, local search interface for the site. The search interface has sorting and faceting capabilities to allow ...
7
votes
2answers
1k views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
2
votes
1answer
267 views

Google Site Search (commercial) not indexing files in sitemap

I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't being reliably indexed. I wrote a script to generate an XML feed (...
1
vote
4answers
3k views

My Xmap generated sitemap is not being submitted

I m using Joomla Xmap component for creating sitemap. Here is the URL of my Xmap generated Sitemap: http://www.acethehimalaya.com/index.php?option=com_xmap&sitemap=1&view=xml I tried to ...
2
votes
1answer
107 views

Url blocked by robots.txt

I badly stuck on error in webmaster tools. I have created Sitemap and when I try to test it on webmaster tools it showing me this below error: Issue : Url blocked by robots.txt Description : ...