A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

5
votes
2answers
1k views

Does sitemap.xml contain links to the entire site?

I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
5
votes
3answers
3k views

How long does it take for Google Webmasters to index site after submitting sitemap? [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have submitted my website today into Google search using Google Webmasters using sitemaps. The status on the sitemap ...
5
votes
3answers
4k views

Sitemap to display hash tag links or not?

I am just creating sitemap for my site and wanted to find out if I should include # links for SEO? For Example: www.mydomain.com/#comment1 www.mydomain.com/#comment2 Does this help with SEO or ...
5
votes
2answers
373 views

What document types can be included in an XML sitemap?

AFAIK, Google accepts sitemaps which are about ordinary URLs (text/plain), images (image/png, image/gif, image/jpg, etc.), and videos (video/avi, video/mpeg, etc.). My question is, how many Internet ...
5
votes
1answer
4k views

Locate sitemap at HTTP or HTTPS?

Our homepage has a 301 redirect from HTTP to HTTPS but all other pages on the site are on HTTP. (1) Should the sitemap be located at HTTPS and is there any problem if we: (2) include the HTTPS ...
5
votes
1answer
2k views

Flat vs. Hierarchical Tree Structure

I'm a developer in the middle of the development of a medium-sized website. A requirement that we just received from the resident SEO person on the project is for all the URLs on the site be just off ...
5
votes
1answer
781 views

Do I reference all my *.xml.gz sitemap files in robots.txt

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files. My question is: ...
5
votes
1answer
606 views

RSS vs Sitemap for SEO

What are the differences of the two and how can they help in SEO? I'm creating a custom-scripted CMS and I'm thinking if should I either add RSS/Sitemap/Both?
5
votes
1answer
597 views

Sitemap XML version vs simple text (urls list) version, do you know what are the pros?

I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :) ...
5
votes
1answer
1k views

SEO: Make hashtag links look static

So I have a website which displays all my content vertically. (like modern websites often do these days). Thus I can't create static links to each section. I'm currently handling the scrolling with ...
5
votes
5answers
5k views

Does Google penalize daily updated <lastmod> tags in sitemaps if the data is not daily updated?

I've got a sitemap that is generated daily with a lot of links to product pages. These products are imported daily from another data source. Because the update consists of throwing away all current ...
5
votes
3answers
2k views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
5
votes
1answer
122 views

Handling SEO for Infinite pages that cause external slow API calls

I have an 'infinite' amount of pages in my site which rely on an external API. Generating each page takes time (1 minute). Links in the site point to such pages, and when a users clicks them they are ...
5
votes
1answer
129 views

How to create google video sitemap urls for very large video files with distinct segments?

I have a large video files about 1 hr in duration, with different sections of the video corresponding to different distinct sub topics . For example, the whole video may be about an yoga exercise ...
4
votes
6answers
3k views

How to tell Google that I have changed my website URLs?

I have done major updates to my website, and renamed all my URLs. How can I tell Google that I have renamed these URLs and let Google refresh its index? My website URL: http://www.pndmasr.com/ My ...
4
votes
2answers
332 views

Is it possible to find out whether one given page has been indexed?

When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog. Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
4
votes
4answers
1k views

Are HTML sitemaps important from a SEO perspective?

Are HTML sitemaps (like this one http://www.google.com/sitemap.html) important from a SEO perspective, or is uploading an XML to Google enough? Beside from visualizing a data structure for the user, ...
4
votes
3answers
180 views

How do you figure out a large site link/structure?

Suppose you're re-designing an existing large site. The first thing to do is to figure out how the site is structured, how many links, pages, sub domains, etc. Is there a tool you can use to crawl a ...
4
votes
2answers
430 views

Frequency to submit sitemap to search engines

I have went live with my site and being new to search engines and SEO fields not sure what should be the best way to handle sitemap.xml. I have created sitemap.xml and submitted it to: Google using ...
4
votes
1answer
48 views

Can a very large not-so-relevant sitemap hurt my site to Google’s eyes?

I have a Wiki site (running MediaWiki) which I am trying to optimize in terms of page speed and SEO. One of the many things in my to-do list is submit a sitemap on Google Webmaster tools, now here is ...
4
votes
1answer
2k views

How often does GWT check dynamic sitemaps?

I'm working on a fairly large site, that generates a dynamic sitemap hourly. Now in Google Webmaster Tools the sitemap isn't submitted yet and I'm shying away because I'm afraid that the new content (...
4
votes
1answer
2k views

Is it necessary to re-submit modified sitemaps?

Assuming a sitemap.xml has been registered properly to major players, do these players come and revisit those sitemap.xml from time to time to check for updates and modifications (say new entries are ...
4
votes
3answers
137 views

My archives are beating my current content, how do I stop from competing against myself?

I've inherited a site with about 15,000 pages going back 16 years. Often current events are outranked by previous events. What are the best techniques to make sure that I'm not fighting against ...
4
votes
1answer
120 views

Can XML Sitemap include itself as one of the URLs?

A little while ago I discovered an XML sitemap where the sitemap itself was included. <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> ...
4
votes
2answers
161 views

Sitemap specified in robots.txt not found by Google

I would like Google to find my sitemap.xml via robots.txt, rather than having to manually upload it. My robots.txt looks like this: User-agent: * Disallow: Sitemap: https://www.recreyo.com/sitemap....
4
votes
3answers
240 views

Will ranking be affected with a mobile XML sitemap for a mobile site with the same URLs as the desktop site?

We have a site with both a desktop version and a mobile version. Most of the content are the same and both versions have the same URL, but the HTML generated is device specific. Looking at Google's ...
4
votes
2answers
478 views

How to improve a single-paged site search result [duplicate]

Possible Duplicate: How to SEO a Single-Page website I created an online CV of mine a couple of weeks ago and it has had quite a few visits. Now I want to improve the chance it will appear in ...
4
votes
1answer
131 views

sitemap.xml : shall I put all my URLs including the ones that have “empty result” for a dataset?

Here's my problem: on my website, you can click on all the regions, and the new web page is the result of the search of the region. Thus the result may be empty. Shall I include all those "empty ...
4
votes
1answer
1k views

Unsupported file format of sitemap - Google

I'm having an issue where I'm submitting my sitemap, too bad I keep this omitted error: Unsupported file format Your Sitemap does not appear to be in a supported format. Please ensure it ...
4
votes
2answers
518 views

Looking for ideas for a site map page on the website

We have a site with a lot of pages. We are in some of the final stages of redesigning the site and am looking for some examples of good site map designs we can be inspired by. Have you seen any good ...
4
votes
1answer
52 views

Moving folder's content to a new domain, what SEO steps to take?

So, we have a functionality on example.com/folder that we decided to make as separate site and we're in need of moving it to a new domain (brand it)... This is what I'm going to make SEO wise (...
4
votes
1answer
2k views

How does “background: url(image.ext)” work from an SEO standpoint?

Forgive me if this has been asked, all I found was SEO: h1 with text vs. h1 with bg image and hidden text which wasn't the same question. Will search engines pick up and index (in their image ...
4
votes
1answer
2k views

Yahoo sitemap ping URL?

We recently used the URL: http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=YahooDemo&url=.... To ping Yahoo about sitemap changes. This URL turned out to time out and ...
4
votes
1answer
135 views

Is it OK to submit the sitemap file to Google without pointing one in the Webmaster Tools?

I'd like to create several sitemaps and gather them into one sitemap index. Then I'd like to submit the sitemap index to Google (and other SE's) using those links. From my point of view it should be ...
4
votes
1answer
160 views

Webmaster tools show old URLs are crawled

We renewed our website last year (2012) in December. After that we have put 301 redirection in place for the required pages. We removed some pages in old site when we moved to new site. For example :...
4
votes
1answer
589 views

MediaWiki sitemap generator

I'm using mediawiki for my site. I'm trying several ways to generate sitemap but it doesn't work. Anyone knows how to generate sitemap for MediaWiki and alert to Google automatically?
4
votes
1answer
238 views

Sitemap with pages missing better than no sitemap at all?

I've inherited a site built with a CMS I'm not familiar with. I've created new pages for the site and I can see they do appear in a html sitemap, but not the xml sitemap. Assuming I can't add the ...
4
votes
1answer
2k views

Sitemap change frequency

I'm sitemapping all my forum topics. It works great: <url> <loc>http://127.0.0.1/scirranew/Forum/Breaks-and-slowdowns-Vram-200_topic32854.html</loc> <lastmod>2010-...
4
votes
1answer
458 views

Determining which sitemap entries not indexed by google

We submit a sitemap to google and can see this being indexed in webmaster tools. We have 5140 entries, and have broken this up to 10 child site maps of 500 each. This all seems to be working well. ...
4
votes
1answer
286 views

Do I need to periodically re-submit my sitemaps to yahoo/bing?

I know Google's webmasters downloads a new version of my sitemaps every day. I am not sure if the yahoo / bing systems do the same thing. Google's says "Downloaded" and for the sitemaps that add the ...
4
votes
2answers
526 views

sitemap that contains millions of links/URLs

I am currently working on a shopping / auction website. The involving party who's doing SEO consultancy is insisting to generate URLs for every single combination of products listed on the website, ...
4
votes
1answer
177 views

Need I submit sitemap in Webmaster Tools?

I have uploaded my sitemap on server root folder. Do I need it submit it in Google Webmaster Tools?
4
votes
2answers
57 views

Possible to check which links in a sitemap are indexed and which ones aren't?

Is it possible to check which links of the sitemap I've submitted are being indexed, and which ones are not? I've submitted my sitemap.xml without errors. When I check the sitemap in google search ...
3
votes
4answers
220 views

www in Sitemap URL's

I was under the impression that www was deprecated but a lot of the sitemap generators seem to rather I use it. I know that Google doesn't like if I mix the two, IE if the URL of the sitemap is http://...
3
votes
4answers
287 views

How sitemap.xml influences indexation?

If a page is missing in sitemap.xml (but crawable through HTML hyperlinks), may this cause it not to be indexed? (I mean it would be indexed without sitemap, but not indexed with sitemap because it is ...
3
votes
3answers
769 views

How do I specify the Google sitemap generator destination directory

Is there a way to specify the location of generated sitemap files using the lastest version of the Google Sitemap Generator? Version is: 1.0.0.0? (a very un-google version number, lol): > sudo /...
3
votes
3answers
769 views

Generate a sitemap automatically, does it need to be XML?

I want to create an XML sitemap (for the sake of SEO), my first attempt to achieve this was by including the website main menu/navigation links using <?php include ("assets/includes/menu.inc"); ?&...
3
votes
2answers
2k views

Can a sitemap index file list sitemaps in a different directory?

If I have a sitemap index, can the sitemaps listed in the index be located in a subdirectory, but have links that isn't specific to the subdirectory? I'm trying to avoid having multiple sitemaps in ...
3
votes
1answer
151 views

Can HTML sitemaps be listed in robots.txt just like XML sitemaps?

I will have two sitemaps for my website. The first sitemap is the .xml version for the search engines. The second sitemap is a sitemap.php on my website for the users. I know I can list the sitemap....
3
votes
2answers
504 views

Which is the best choice for SEO sitemap for multilingual website?

In my site when someone access directly the domain.com or any other url that does not contain country indication like domain.com/contact, the language content is shown based on his IP. for example if ...