A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

1
vote
1answer
4k views

How to fix Google 404 not found Crawl Errors?

I was checking on Google webmater tool for my blog site to see if there's any indication on why my blog traffic decreased to half in one day and i saw 43 Not Found crawl errors and 5 in Sitemap Not ...
1
vote
1answer
204 views

Is this Sitemap code correct? [closed]

I'd like to check whether I have any of the code not as it should be in my Sitemap file. Not sure if this is too general a question for here... If it's an ok question, here's the sitemap URL: ...
1
vote
1answer
179 views

I want the links in my HTML sitemap to be crawled but I do not want the sitemap in the SERPs

I have a website that has some pages and then it has a folder that has the majority of the pages. All the pages that exist in this folder could only be accessed by using my website search engine, then ...
1
vote
1answer
110 views

Sitemap file entries for blog and main php site

I'm creating a sitemap manually. It's a PHP site with a WordPress blog. Here's the main site: http://wordfruit.com And here's the blog: http://blog.wordfruit.com Can I put the blog URL in the ...
1
vote
1answer
417 views

Problem with Google indexing URLs in my XML SiteMap

My XML sitemap has a lot of links - for example: nanoc.gigfa.com/post.php?id=1 nanoc.gigfa.com/post.php?id=2 nanoc.gigfa.com/post.php?id=3 nanoc.gigfa.com/post.php?id=4 ...
1
vote
2answers
308 views

When does Google Webmaster Tools re-evaluate re-submitted sitemaps?

When I alter and re-submit a sitemap does GWTs immediately re-evaluate it or do I have to wait 'til GoogleBot crawls our site again? I just re-submitted a problematic sitemap and it now displays ...
1
vote
2answers
61 views

Do Google sitemap URLs need to be double urlencoded?

Do Google sitemap URLs need to be double urlencoded? I am submitting my sitemaps to Google and Google is having difficulty navigating to URLs that contain urlencoded characters. An example of a ...
1
vote
1answer
45 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: ...
1
vote
1answer
18 views

Sitemap for WordPress extension

I'm using an extension to integrate a WordPress blog into my eCommerce site. WordPress is installed in its own directory with a link called blog on my home page. I used a free extension to do this. ...
1
vote
2answers
25 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
1
vote
1answer
112 views

Is there any advantage or disadvantage to add subdomain twice in search engines?

I have a domain (example.com) and some subdomains (e.g., sd1.example.com, ...). I added example.com to Google and Bing Webmaster Tools. I added example.com/sitemap and sd1.example.com/sitemap (with a ...
1
vote
1answer
265 views

My Domain Name Appears Twice in Most of My URLs

I've recently been adding some backlinks to other articles within my site. I don't know if it's this that is now causing me a problem. I now notice that Google has indexed my sites pages again but ...
1
vote
1answer
50 views

Sitemaps for growing content and googlesitemapgenerator

The number of URLs on my website is constantly growing (by 10-50 per week or so). Should I: Regularly submit an updated sitemap including all URLs. Have a sitemap of only the static content of my ...
1
vote
1answer
71 views

What is the proper SEO way to add and remove links to our site and sitemap?

As content fluctuates on our site, we will obviously add the titles to the new pages to our sitemap, and link list for search engine indexing. Through time, certain links will become less relevant, ...
1
vote
2answers
76 views

two sitemaps - possible problems?

I am using a web shop software and for some reason the main page (http://www.mysite.com/) is not being listed / generated within the automatic sitemap.xml while every other page is. My question now: ...
1
vote
1answer
2k views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
1
vote
1answer
146 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
1
vote
1answer
207 views

How to create and submit multiple sitemaps into categories?

I have a questions. I need to know how to create and submit multiple sitemaps into categories? This is for a big online auction site with a lot of products that needs to be indexed.
1
vote
2answers
201 views

Why google doesn't index youtube videos in sitemap?

I've created a sitemap for youtube hosted videos in my website. you can find it here. http://www.informaincasa.it/wp-content/uploads/sitemap-video.xml I've also created a sitemap for videos hosted on ...
1
vote
2answers
599 views

Google Webmaster Tools URLs in the index differ from the sitemap. How comes?

Google Webmaster Tools says ~14000 URLs in the index but as you can see in the following picture there are only ~6500 from the sitemap. How comes? I mean: my website is not properly "crawl-able". So ...
1
vote
1answer
63 views

Sitemap creators not visiting most pages

I am trying to generate a sitemap for a customers website, http://www.ruralmarketing.co.nz . When I use the online generators it only ever creates a sitemap with two urls, the index and contact page. ...
1
vote
1answer
93 views

Making search engine crawl my site

I have a site with visitors from all over the world, and I'm trying to optimize indexed pages on search engines beside Google (he indexed most of my pages). I see that on Japan search engines I'm ...
1
vote
1answer
71 views

What's Required for the AudioObject in Schema.org

We're trying to paint our site with the correct Schema.org information, and we're getting the following error: ...
1
vote
1answer
249 views

How Does One Make a Sitemap for a Flex Website?

I've got a Flex website and I'm not sure how to make a sitemap for it. For a standard HTML page, sitemaps are straight forward. As Flex sites use a "pageless" architecture, I'm not sure what I should ...
1
vote
2answers
618 views

Yahoo sitemap validation

I am trying to submit sitemap.xml (Index) to Yahoo Site Explorer but with no luck. I tried using website feed option in the site explorer to submit the sitemap, but I got validation errors. However, ...
1
vote
1answer
86 views

What are Sitemap content tags?

i have recently generated sitemap for google. I included following loc, lastmod, changefreq. My site is in two languages. Do i need to add some other tags for specifying languages too
1
vote
3answers
828 views

Where can I find a list of search engine crawler user agents and their domain names?

I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
1
vote
2answers
22 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
1
vote
1answer
29 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
41 views

Moved sitemaps to a different subdomain and losing search referrals around the same time. Red herring or correlation?

We started to lose search referral traffic around the same time that I moved some of our sitemaps to a subdomain. Could this have hurt us? I followed Google's steps to creating a sitemap under a ...
1
vote
1answer
89 views

How to check if a WordPress SEO plugin is working

I have setup my WordPress site with Yoast. However, it doesn't seem to appear in any of the search engines. In Google Webmaster Tools I don't see a sitemap. Is the plugin supposed to submit the ...
1
vote
1answer
66 views

What to do with discontinued product pages? [duplicate]

I have a site that reviews personal medical devices. Each year, these medical devices get replaced a few times by their newer/improved versions, so the old devices are not available anywhere ...
1
vote
1answer
133 views

Webmaster Tools: root and subdirectories?

We have all our international sites on our .com domain like this: site.com/uk site.com/us etc... When creating the sites in Webmaster Tools I've created different sites and submitted sitemaps for ...
1
vote
1answer
170 views

Google's webmaster tools saying invalid URL in sitemap

I've recently made some big changes to my site and as a result, have had to change my sitemap. In doing so, I resubmitted my sitemap file only to see 3 errors reading invalid URL's. I'm not sure if ...
1
vote
0answers
212 views

Powermapper alternatives and Google Analytics? [closed]

What is a good application to map the hierarchical structure of a website and maybe get some Google Analytics action going on? Powermapper is pretty expensive and the trial version didn't seem ...
1
vote
1answer
244 views

Displaying thumbnails in google search results for flash games?

Some sites are somehow displaying video preview thumbnails for pages that contain flash games in google search results. For example search for: site:www.thorgaming.com game I see this only on small ...
1
vote
1answer
463 views

Google sitemap access error, something to do with .htaccess redirect from http://www. to http://

I recently updated the htaccess of my site to redirect from http://www. to http://. It all works fine but now I've made some changes to my site and uploaded a new sitemap.xml to google webmaster. I'm ...
1
vote
0answers
332 views

sitemap - following mvcsitemapprovider but categorization is confusing me [closed]

I'm using mvcsitemapprovider for sitemap. http://mvcsitemap.codeplex.com/ public class StoreDetailsDynamicNodeProvider : DynamicNodeProviderBase { MusicStoreEntities storeDB = ...
1
vote
0answers
128 views

How does Stack Overflow have questions appear in Google so quickly? [duplicate]

Possible Duplicate: StackOverflow and Google search I have noticed while asking questions on Stack Overflow that they appear in Google almost instantly. How does SO do this? Is it a feed ...
1
vote
3answers
668 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
0
votes
3answers
25 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
0
votes
1answer
341 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
0
votes
1answer
39 views

Google say: robots.txt not valid for subdomains?

I'm very confused about Google's robots.txt documentation Examples of valid robots.txt URLs: Not valid for http://other.example.com/ https://example.com/ http://example.com:8181/ ...
0
votes
1answer
40 views

If my index page has no textual content, should it be present in sitemap?

My index page contains no textual content at all (except some footer links, copyright notice and some stuff in tag). It has, however, big Google's map with some pins attached which lead to articles. ...
0
votes
1answer
75 views

Trade off: Lower the number of URLs in sitemap from 43k to 23k or update the sitemap.xml only weekly basis

we rewrote the sitemap creation process. Now the sitemap contains 43.000 URLs. 20k more than before. We have daily changing in URLs. The script that is creating the complete sitemap takes more than ...
0
votes
3answers
151 views

Google is not indexing the entirety of my site [duplicate]

I require google to index the entirety of my site: 10 or so basic sections with 80,000+ individual job offer pages. However, to date, only 2,900 pages have been indexed by google. I'd like to know ...
0
votes
1answer
109 views

online site map generator that has an access via URL [duplicate]

Possible Duplicate: Looking for a sitemap generator I am looking for a service that I can access daily based to generate a sitemap.xml file for SEO. Something like ...
0
votes
1answer
43 views

What is the optimal way to apply categories to a new site?

To whit: I run a men's lifestyle Q&A site. I have a total of 25 categories in which questions are submitted. Currently, however, these "categories" are in fact sub-categories, such that ...
0
votes
2answers
37 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
0
votes
2answers
62 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...