A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

1
vote
1answer
102 views

Creating more than one sitemap and relating it to a subdomain - will I be penalized?

I'm thinking in creating a subdomain containing all the reviews from my products, for example: http://reviews.mystore.com At this subdomain, I have my sitemap.xml pointing for the reviews page about ...
1
vote
1answer
171 views

Is it a problem for Google if robots.txt blocks URLs in the sitemap?

I had submitted my site's URL to Google Webmaster Tools. I am using OpenCart. I also have robots.txt file which is accessible to Googlebot. Now issue I am facing: Googlebot is blocked from accessing ...
1
vote
2answers
147 views

Do Google sitemap URLs need to be double urlencoded?

Do Google sitemap URLs need to be double urlencoded? I am submitting my sitemaps to Google and Google is having difficulty navigating to URLs that contain urlencoded characters. An example of a ...
1
vote
1answer
55 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: ...
1
vote
1answer
21 views

Sitemap for WordPress extension

I'm using an extension to integrate a WordPress blog into my eCommerce site. WordPress is installed in its own directory with a link called blog on my home page. I used a free extension to do this. ...
1
vote
2answers
58 views

Sitemap structure for network of subdomains

I am working on a project that's a network of 2 domains (domain.gr & domain.com.cy) of subdomains similar to Hubpages [each user gets a profile under a different subdomain & there is a ...
1
vote
2answers
62 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
1
vote
1answer
156 views

Is there any advantage or disadvantage to add subdomain twice in search engines?

I have a domain (example.com) and some subdomains (e.g., sd1.example.com, ...). I added example.com to Google and Bing Webmaster Tools. I added example.com/sitemap and sd1.example.com/sitemap (with a ...
1
vote
1answer
449 views

My Domain Name Appears Twice in Most of My URLs

I've recently been adding some backlinks to other articles within my site. I don't know if it's this that is now causing me a problem. I now notice that Google has indexed my sites pages again but ...
1
vote
1answer
53 views

Sitemaps for growing content and googlesitemapgenerator

The number of URLs on my website is constantly growing (by 10-50 per week or so). Should I: Regularly submit an updated sitemap including all URLs. Have a sitemap of only the static content of my ...
1
vote
1answer
73 views

What is the proper SEO way to add and remove links to our site and sitemap?

As content fluctuates on our site, we will obviously add the titles to the new pages to our sitemap, and link list for search engine indexing. Through time, certain links will become less relevant, ...
1
vote
2answers
90 views

two sitemaps - possible problems?

I am using a web shop software and for some reason the main page (http://www.mysite.com/) is not being listed / generated within the automatic sitemap.xml while every other page is. My question now: ...
1
vote
1answer
158 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
1
vote
1answer
263 views

How to create and submit multiple sitemaps into categories?

I have a questions. I need to know how to create and submit multiple sitemaps into categories? This is for a big online auction site with a lot of products that needs to be indexed.
1
vote
2answers
632 views

Google Webmaster Tools URLs in the index differ from the sitemap. How comes?

Google Webmaster Tools says ~14000 URLs in the index but as you can see in the following picture there are only ~6500 from the sitemap. How comes? I mean: my website is not properly "crawl-able". So ...
1
vote
1answer
72 views

Sitemap creators not visiting most pages

I am trying to generate a sitemap for a customers website, http://www.ruralmarketing.co.nz . When I use the online generators it only ever creates a sitemap with two urls, the index and contact page. ...
1
vote
1answer
93 views

Making search engine crawl my site

I have a site with visitors from all over the world, and I'm trying to optimize indexed pages on search engines beside Google (he indexed most of my pages). I see that on Japan search engines I'm ...
1
vote
1answer
76 views

What's Required for the AudioObject in Schema.org

We're trying to paint our site with the correct Schema.org information, and we're getting the following error: ...
1
vote
1answer
253 views

How Does One Make a Sitemap for a Flex Website?

I've got a Flex website and I'm not sure how to make a sitemap for it. For a standard HTML page, sitemaps are straight forward. As Flex sites use a "pageless" architecture, I'm not sure what I should ...
1
vote
2answers
660 views

Yahoo sitemap validation

I am trying to submit sitemap.xml (Index) to Yahoo Site Explorer but with no luck. I tried using website feed option in the site explorer to submit the sitemap, but I got validation errors. However, ...
1
vote
1answer
86 views

What are Sitemap content tags?

i have recently generated sitemap for google. I included following loc, lastmod, changefreq. My site is in two languages. Do i need to add some other tags for specifying languages too
1
vote
3answers
996 views

Where can I find a list of search engine crawler user agents and their domain names?

I'm trying to follow stackoverflow's approach of using a white list for the sitemap. I have tried to find an extensive list of search engine crawlers (and other crawlers) to use in my white list but ...
1
vote
1answer
41 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
77 views

Moved sitemaps to a different subdomain and losing search referrals around the same time. Red herring or correlation?

We started to lose search referral traffic around the same time that I moved some of our sitemaps to a subdomain. Could this have hurt us? I followed Google's steps to creating a sitemap under a ...
1
vote
1answer
112 views

How to check if a WordPress SEO plugin is working

I have setup my WordPress site with Yoast. However, it doesn't seem to appear in any of the search engines. In Google Webmaster Tools I don't see a sitemap. Is the plugin supposed to submit the ...
1
vote
1answer
72 views

What to do with discontinued product pages? [duplicate]

I have a site that reviews personal medical devices. Each year, these medical devices get replaced a few times by their newer/improved versions, so the old devices are not available anywhere ...
1
vote
1answer
251 views

Google's webmaster tools saying invalid URL in sitemap

I've recently made some big changes to my site and as a result, have had to change my sitemap. In doing so, I resubmitted my sitemap file only to see 3 errors reading invalid URL's. I'm not sure if ...
1
vote
0answers
246 views

Powermapper alternatives and Google Analytics? [closed]

What is a good application to map the hierarchical structure of a website and maybe get some Google Analytics action going on? Powermapper is pretty expensive and the trial version didn't seem ...
1
vote
1answer
264 views

Displaying thumbnails in google search results for flash games?

Some sites are somehow displaying video preview thumbnails for pages that contain flash games in google search results. For example search for: site:www.thorgaming.com game I see this only on small ...
1
vote
1answer
587 views

Google sitemap access error, something to do with .htaccess redirect from http://www. to http://

I recently updated the htaccess of my site to redirect from http://www. to http://. It all works fine but now I've made some changes to my site and uploaded a new sitemap.xml to google webmaster. I'm ...
1
vote
0answers
379 views

sitemap - following mvcsitemapprovider but categorization is confusing me [closed]

I'm using mvcsitemapprovider for sitemap. http://mvcsitemap.codeplex.com/ public class StoreDetailsDynamicNodeProvider : DynamicNodeProviderBase { MusicStoreEntities storeDB = ...
1
vote
0answers
130 views

How does Stack Overflow have questions appear in Google so quickly? [duplicate]

Possible Duplicate: StackOverflow and Google search I have noticed while asking questions on Stack Overflow that they appear in Google almost instantly. How does SO do this? Is it a feed ...
1
vote
3answers
859 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
0
votes
3answers
28 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
0
votes
1answer
365 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
0
votes
1answer
121 views

Google say: robots.txt not valid for subdomains?

I'm very confused about Google's robots.txt documentation Examples of valid robots.txt URLs: Not valid for http://other.example.com/ https://example.com/ http://example.com:8181/ ...
0
votes
1answer
304 views

Is it recommend to create sitemaps with query strings (i.e. URL parameters)?

I am considering creating a "My products" page on a site where a user will be able to search for product information. This page will also display the product information. I need google to know about ...
0
votes
1answer
40 views

If my index page has no textual content, should it be present in sitemap?

My index page contains no textual content at all (except some footer links, copyright notice and some stuff in tag). It has, however, big Google's map with some pins attached which lead to articles. ...
0
votes
1answer
78 views

Trade off: Lower the number of URLs in sitemap from 43k to 23k or update the sitemap.xml only weekly basis

we rewrote the sitemap creation process. Now the sitemap contains 43.000 URLs. 20k more than before. We have daily changing in URLs. The script that is creating the complete sitemap takes more than ...
0
votes
3answers
159 views

Google is not indexing the entirety of my site [duplicate]

I require google to index the entirety of my site: 10 or so basic sections with 80,000+ individual job offer pages. However, to date, only 2,900 pages have been indexed by google. I'd like to know ...
0
votes
1answer
111 views

online site map generator that has an access via URL [duplicate]

Possible Duplicate: Looking for a sitemap generator I am looking for a service that I can access daily based to generate a sitemap.xml file for SEO. Something like ...
0
votes
1answer
44 views

What is the optimal way to apply categories to a new site?

To whit: I run a men's lifestyle Q&A site. I have a total of 25 categories in which questions are submitted. Currently, however, these "categories" are in fact sub-categories, such that ...
0
votes
2answers
32 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
0
votes
1answer
30 views

Two WordPress Blogs on Same Domain - How to add SiteMap?

I have a two WordPress blogs on same domain. Ex : example.com -- 0ne WordPress installation and example.com/tutorials -- another WordPress installation example.com has very less content(As well as ...
0
votes
2answers
436 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
0
votes
2answers
147 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
0
votes
2answers
112 views

How to get Google to display a list of posts in the SERPs for a self hosted WordPress blog?

My website is javatechig.com and is around 6 months old. I have used All-in-One SEO WordPress plugin for SEO tricks. Definitely after using SEO plugin, my website page view is increased, but still it ...
0
votes
2answers
83 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
0
votes
2answers
224 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
0
votes
1answer
1k views

google image sitemap title and caption, which is more important?

here is the document about google image sitemap, But <image:caption> and <image:title>, which is more important? if i have only one description of this image, which part is better to be ...