A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

1
vote
2answers
1k views

Huge drop in indexed pages [duplicate]

Possible Duplicate: Why the # of indexed pages got dicreased? My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
1answer
305 views

Sitemap vs nofollow

I have a sitemap on my site, which includes all users from the site. On the user profile page, tho, I don't want google to index all users, only those with more than 10 posts, so I've added a meta ...
1
vote
2answers
174 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
1
vote
1answer
31 views

Removing items from a sitemap

I'm having a problem removing some unwanted links from my sitemap. The hierarchy which we have in the sitemap is incorrect. I don't want that be like that. Is there any way which I can change it? ...
1
vote
1answer
240 views

change sitemap after 301 redirect

when i use of 301 redirect for all URLs ... should i change sitemap URLs ??? ...... if Sitemap contains following URLs example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html should i ...
1
vote
2answers
340 views

Sitemap indexed count and Google results difference

My sitemap claims they have indexed over 3 thousand pages from it but when i do a site command in Google site:http://domain.com It returns 200 pages. I have heard of the sitemap index count ...
1
vote
2answers
74 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
1
vote
1answer
195 views

How do I remove these errors from my blog so as to get adsense approved?

This is the question I asked on SO site earlier, but didn't get satisfactory replies. hoping to find a solution here.. ...
1
vote
2answers
59 views

Which of these url for Feeds for the Sitemap should I use?

Does it matter which of these I add to my Sitemaps file? http://example.com/?feed=rss http://example.com/?feed=rss2 http://example.com/?feed=rdf http://example.com/?feed=atom
1
vote
3answers
325 views

xml sitemap structure

I have been arguing a point and would like a second opinion. The basic point of contention is as follows: We have a site X with a sitemap index file located at: http://www.x.co.uk/sitemap.xml ...
1
vote
1answer
1k views

is it ok to have 2 sitemaps on 1 website?

Do I have to have a sitemap page on my index page for bots to read it or can I just have it anywhere on my server? I have a phpbb/wordpress integration and I need 2 sitemaps mods for each one (or I ...
1
vote
2answers
359 views

How can I allow robots access to my sitemap, but prevent casual users from accessing it?

I am storing my sitemaps in my web folder. I want web crawlers (Googlebot etc) to be able to access the file, but I don't necessarily want all and sundry to have access to it. For example, this site ...
1
vote
1answer
51 views

How to tell crawler my sitemaps in a zip file?

I have 2 big sitemaps (map1.xml, map2.xml) and I have a index file (indexmap.xml) that contains the locations of these 2 files. I zip these 3 files to mymaps.zip. In Google Webmaster Tools, should I ...
1
vote
2answers
78 views

How do I replace all my XML Sitemaps without hurting SEO?

I am looking for someone to tell me the appropriate procedure to replace all Google sitemaps. I can clearly go in and delete the old ones and simply replace them, but as it can sometimes take many ...
1
vote
1answer
42 views

Should I submit XML sitmaps directly or list them in my robots.txt?

Are there advantages to listing XML sitemap files in robots.txt vs submitting them directly to Google via Webmaster Tools?
1
vote
1answer
33 views

Should a URL shortener service provide XML sitemap entries for shortened URLs?

As a fun project I've written my own URL shortening service. I'd like to know if it makes sense / be useful to include the shortened URLs in the generated XML sitemap. At the moment I'm leaning ...
1
vote
1answer
72 views

Should I have a separate sitemap for mobile pages and include that in my robots.txt?

I am working on site that has 20 mobile-friendly pages which are located under a /mobile directory. Should I have a separate sitemap for these mobile pages and include both this and the desktop ...
1
vote
1answer
101 views

Google not index my hosted-blog after adding custom domain

I started a blog since 1 year ago . And my blog was perfectly appearing on google search . But , some days ago , i have set up a custom domain with godaddy . and then submit my new site and a fresh ...
1
vote
1answer
75 views

Does the number of times the sitemap has been updated affect SEO positively?

Does the number of sitemaps on Webmaster Tools affect the Google ranking at all? My website contains two different feeds of constant weekly updates and was wondering whether I should consider ...
1
vote
3answers
93 views

Can canonical tags be placed in the sitemap rather than in each page?

We have canonical tags spread across our web pages. Is it possible to add the canonical tags in our sitemap instead? If yes, how?
1
vote
1answer
71 views

Can I submit duplicate image, video, and content sitemaps to Google Webmaster Tools?

Can I submit 3 duplicate sitemaps (image, video, content) which have same URLs to Google Webmaster Tools? Image Sitemap 1: <loc>http://mywebsite.com/article1</loc> <video:video> ...
1
vote
1answer
33 views

Can I use sitemap index for media RSS (mRrss) files?

I have a lot of mRSS (media Rss) files. I plan to create sitemap index to contain them. Are sitemaps allowed to contain mRss files? To my knowledge, they are only allowed to contain image, video, ...
1
vote
1answer
100 views

changing URL format afftects SEO reputation and not considering 301 redirection

We had URL http://www.example.com/category/subcategory.html which changed to http://www.example.com/category/filter/cat/subcategory.html We did 301 redirection, updated canonical URL to new one also ...
1
vote
2answers
227 views

Need to encourage google to refresh robots.txt [duplicate]

My old robots.txt is User-agent: * Disallow: / Is blocking me for uploading a new sitemap and also blocking me for fetching robots.txt manually. I don't know what to do.
1
vote
2answers
68 views

HTML Sitemap URL format

When adding a html sitemap to a site, for SEO purposes should the links it contains be locally referenced or is it better to use the full URL? Eg: <ul> <li><a ...
1
vote
2answers
67 views

Should I use a video sitemap when my video URLs change every two hours to prevent hotlinking?

I have over 10k videos hosted on my server, and I'm using lighttpd to switch the video URLs every 2 hours because of hotlinking protection. This means that all video URLs in video sitemap is only ...
1
vote
1answer
74 views

Why I see my page sitemap XML link in Google?

I am using Yoast SEO plugin for my WordPress website. I am also using Yoast's XML Sitemap. Today I checked my pages in Google and found this indexed by Google: Title: http://example.com/ ...
1
vote
1answer
372 views

Flat vs. Hierarchical Tree Structure (vol. 2)

This relevant question deals with whether a site URL structure is better (SEO-wise) to be flat or hierarchical. How much important is it for a site ranking if the overall structure is flat or ...
1
vote
3answers
79 views

Is it necessary to link to all landing pages from the homepage?

What I am wanting to do is build quite a few landing pages targeting specific keywords from google search. These pages will give a brief explanation of what we do and how we can help them with what ...
1
vote
1answer
82 views

If the size of sitemap is limited: how do I tell to Google all of my URLs?

I heard that the sitemap for Google can not exceed 10 Mb and 50 kURLs. This is not enough for me. What shell I do to pass through this obstacle? Create sitemap for each category?
1
vote
2answers
120 views

Should pages linked to in my nav and footer be included in my sitemap?

I'm more of a back end developer and can't answer this question from my own research. When setting up the links in my sitemap, do I need to include the pages that I link to in my top navigation and ...
1
vote
2answers
59 views

Do search engines rank URLs in sitemaps lower if there are no internal links pointing to them?

I have a site with thousands of pages. The pages are dedicated to be found by the search engines as they are very specific. It is very unlikely that the users will find necessary pages using any ...
1
vote
1answer
2k views

Sitemap for a one-page site

I'm wondering whether it's worth the effort to create a sitemap for a single-page site. By single page I'm not talking about a webapp made with Angular or Backbone, just a presentation site/page ...
1
vote
1answer
266 views

Creating sitemap for Googlebot - how to mark dynamic content / dynamic subpages?

I have a website that is an Internet forum. This forum has many categories, and a single category page that contains a lot of subpages with listed threads. This Internet forum is brand new, and about ...
1
vote
1answer
160 views

Server gzip compression vs gzipped sitemap

My client's SEO guy said that search engines prefer gzipped sitemaps. They keep their sitemap in .xml.gz file. I was wondering if there is any difference for search engines between a gzipped ...
1
vote
1answer
48 views

Should I leave old events in my sitemap?

Should I leave old events in my sitemap that have passed, or remove them? The sitemap is quite huge and I didn't know if that was OK.
1
vote
1answer
113 views

Should ecommerce checkout pages be included in sitemap.xml?

My ecommerce site has a variety of pages specific to the checkout-out process. These include "Cart", "Billing", "Shipping", "Discount", "Finish", and "Complete Order". In general, should I be ...
1
vote
1answer
122 views

Why is this date in my sitemap “invalid” according to Google

My XML sitemap file has <lastmod>2013-07-06T09:39:51-0400</lastmod> formatted with W3C Datetime Format. Google has a warning message in webmaster tools about this for me: Google's ...
1
vote
2answers
78 views

Which pages should be present in the sitemap

So if I have a WordPress blog for example, then out of the following which should be present in the sitemap and which should not be? posts - these will be obviously. pages - should be. categories - ...
1
vote
3answers
93 views

SEO sitemap submission

I always assumed SEO was simply a buzzword that meant "using content that makes sense". Obviously it gets a little bit more complicated than that, using realistic search terms in header tags and ...
1
vote
1answer
98 views

browse-able hierarchy vs. sitemap

The current site navigation is done through a search form. UX wise, I feel it's the best solution we can currently offer our uses. Because this is the case, I have a sitemap that covers all the pages ...
1
vote
2answers
96 views

sitemap for non-CMS based website

I've just finished a new version of my website but now I don't know how to generate a correct sitemap. Now the website is based on PHP files and folder and in blog folder there is Wordpress. This is ...
1
vote
2answers
703 views

Why does google crawl my page only once even I set changefreq:daily?

I have built a new site, submitted my homepage URL to Google, and my sitemap(I have about 6,300 pages.). Now when I type site:mydomain.com, there have 1,992 pages have crawled. But they were all ...
1
vote
2answers
363 views

Creating Google sitemap.xml , is it okay for the images to be wrapped in URL tags?

I'm using a tool to generate the sitemap.xml file for me, it started to crawl my website, got the pages and all images, but when exporting it, I review the XML (to make sure nothing is wrong) and I ...
1
vote
1answer
160 views

article url format for google news sitemap

I have 2 questions about url for google news sitemap. Is it good that I use= url for sitemap witch like ...
1
vote
2answers
127 views

Robots.txt and sitemaps

If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in the xml sitemap or not? Edit: If i ...
1
vote
1answer
626 views

ASP.NET MVC SEO friendly URLs and Sitemap

I've created an ASP.NET MVC 3 application and generated sitemap.xml using some free online tools. It contains the following URLs: http://www.mydomain/ http://www.mydomain/About ...
1
vote
1answer
4k views

How to fix Google 404 not found Crawl Errors?

I was checking on Google webmater tool for my blog site to see if there's any indication on why my blog traffic decreased to half in one day and i saw 43 Not Found crawl errors and 5 in Sitemap Not ...
1
vote
1answer
238 views

Is this Sitemap code correct? [closed]

I'd like to check whether I have any of the code not as it should be in my Sitemap file. Not sure if this is too general a question for here... If it's an ok question, here's the sitemap URL: ...
1
vote
1answer
202 views

I want the links in my HTML sitemap to be crawled but I do not want the sitemap in the SERPs

I have a website that has some pages and then it has a folder that has the majority of the pages. All the pages that exist in this folder could only be accessed by using my website search engine, then ...