A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

1
vote
0answers
130 views

How does Stack Overflow have questions appear in Google so quickly? [duplicate]

Possible Duplicate: StackOverflow and Google search I have noticed while asking questions on Stack Overflow that they appear in Google almost instantly. How does SO do this? Is it a feed ...
1
vote
3answers
913 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
0
votes
3answers
28 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
0
votes
1answer
374 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
0
votes
3answers
31 views

What should I do with videos which gets taken down by copyright claim?

I own a small video tube website, where users upload a specific kind of content. 1,000 videos have been uploaded so far. This morning I received copyright claim asking me to remove or disable access ...
0
votes
1answer
140 views

Google say: robots.txt not valid for subdomains?

I'm very confused about Google's robots.txt documentation Examples of valid robots.txt URLs: Not valid for http://other.example.com/ https://example.com/ http://example.com:8181/ ...
0
votes
1answer
378 views

Is it recommend to create sitemaps with query strings (i.e. URL parameters)?

I am considering creating a "My products" page on a site where a user will be able to search for product information. This page will also display the product information. I need google to know about ...
0
votes
1answer
40 views

If my index page has no textual content, should it be present in sitemap?

My index page contains no textual content at all (except some footer links, copyright notice and some stuff in tag). It has, however, big Google's map with some pins attached which lead to articles. ...
0
votes
1answer
78 views

Trade off: Lower the number of URLs in sitemap from 43k to 23k or update the sitemap.xml only weekly basis

we rewrote the sitemap creation process. Now the sitemap contains 43.000 URLs. 20k more than before. We have daily changing in URLs. The script that is creating the complete sitemap takes more than ...
0
votes
3answers
162 views

Google is not indexing the entirety of my site [duplicate]

I require google to index the entirety of my site: 10 or so basic sections with 80,000+ individual job offer pages. However, to date, only 2,900 pages have been indexed by google. I'd like to know ...
0
votes
1answer
111 views

online site map generator that has an access via URL [duplicate]

Possible Duplicate: Looking for a sitemap generator I am looking for a service that I can access daily based to generate a sitemap.xml file for SEO. Something like ...
0
votes
1answer
44 views

What is the optimal way to apply categories to a new site?

To whit: I run a men's lifestyle Q&A site. I have a total of 25 categories in which questions are submitted. Currently, however, these "categories" are in fact sub-categories, such that ...
0
votes
2answers
37 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
0
votes
1answer
39 views

Two WordPress Blogs on Same Domain - How to add SiteMap?

I have a two WordPress blogs on same domain. Ex : example.com -- 0ne WordPress installation and example.com/tutorials -- another WordPress installation example.com has very less content(As well as ...
0
votes
2answers
628 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
0
votes
2answers
187 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
0
votes
2answers
116 views

How to get Google to display a list of posts in the SERPs for a self hosted WordPress blog?

My website is javatechig.com and is around 6 months old. I have used All-in-One SEO WordPress plugin for SEO tricks. Definitely after using SEO plugin, my website page view is increased, but still it ...
0
votes
2answers
85 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
0
votes
2answers
248 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
0
votes
2answers
1k views

In a Google image sitemap, is the title or the caption more important?

Here is the document about google image sitemaps. Of <image:caption> and <image:title>, which is more important? If I have only one description of this image, which part is better to be ...
0
votes
3answers
97 views

Website configuraiton for SEO Optimization

In order to promote our product in the various search engines, we've changed our index.html to redirect to ourapp.com/product/index.html and moved all our HTML code to ourapp.com/product/index.html ...
0
votes
2answers
764 views

Google sitemap for dynamic url structure

I am wondering what the best approach would be to generating a sitemap for google to crawl with a highly dynamic url structure. We have a webapp that assigns custom uris to all the users in our ...
0
votes
1answer
133 views

If Apache applies compression with mod_deflate, is there a reason to serve compressed files?

I have an Apache HTTP server which is configured with mod_deflate to compress content "on the fly". Is there any benefit if I serve a compressed sitemap.xml.gz file, or should I rely on mod_deflate ...
0
votes
1answer
275 views

Code for sitemap — 'weekly.?

I'm creating a Sitemap manually. If I want to specify a url to be crawled weekly, is this the right code: <url> <loc>http://wordfruit.com/</loc> ...
0
votes
1answer
193 views

Sitemap.xml.gz. can I have a compressed file with more than one sitemap in it?

I've got quite a few sitemaps as my site is quite large. Is there any way that I can have a compressed with with multiple sitemap files in it ? I've googled but can't find the answer to this
0
votes
3answers
30 views

sitemap not being indexed

I am new to google SEO , created a sitemap with 636 URLs according to all the advices i found from this very useful forum , I have tried your ideas 3 to 4 times with Google , we waited and waited them ...
0
votes
1answer
21 views

Google Webmaster Tools is reporting that some URLs listed my sitemap have a high response time [duplicate]

In Google Webmaster Tools looking at a new clients site, I'm seeing sitemap errors that I haven't seen before with this message: Some URLs listed in this Sitemap have a high response time. This ...
0
votes
1answer
21 views

How to deal with unreferenced pages but exists in sitemap

Is it OK to have pages that are not referenced by any anchor links, but they do exist in the Sitemap file? Will Google penalise this behaviour or consider this as spam site?
0
votes
1answer
40 views

Sitemap submitted to HTTPS profile also influenced HTTP profile in Google Webmaster Tools

Recently I upgraded a site to use an SSL certificate and noticed strange behaviour with Google Webmaster Tools. Before starting the changes Google WMT Sitemap for http://www.example.com was showing ...
0
votes
1answer
40 views

Why do sitemaps generated by different plugins look so different from each other?

This is my first time generating a sitemap. I used two plugins to compare sitemaps. Yoast generated a normal looking sitemap. But the sitemap generated by Google XML Sitemaps plugin looks weird (see ...
0
votes
1answer
66 views

Cleanup incorrectly indexed subdomains due to wildcard DNS

I have site www.example.com which someone previously configured with wildcard DNS records and with no 301 redirects. As you may have expected, Google's index is now full of garbage like w.example.com, ...
0
votes
1answer
45 views

What resolution in sitemap.xml image attribute?

I'm just creating a sitemap for my page and I found these aspects for creating it on Google: https://support.google.com/webmasters/answer/183668 There is a attribute for images, but my question is: ...
0
votes
1answer
58 views

Website with over 1 million posts with not much textual content

I've made a website which crawls files from all over the Internet and I feel like Google will ban me if I sent it sitemaps which contain all of these pages (1m+), because they contain only the file ...
0
votes
1answer
145 views

Is there any reason to add pagination to sitemap?

Let's say I have the following site structure: root category1 item1 item2 .... item99 category2 item101 item102 .... item199 ... Each category page contain ...
0
votes
1answer
225 views

Submitting vBulletin Sitemap to Google

I'm using Google Webmaster Tools to get my forum out there, and when I go to submit the sitemap I get the following error: Your Sitemap appears to be an HTML page. Please use a supported ...
0
votes
1answer
64 views

insert multi post page in sitemap or not?

i want to insert below links in Sitemap, Each page has its own unique content : http://poetry.qrosh.com/en/William%20Shakespeare/A%20Fairy%20Song/1/1/ so if i have multi post pages which include 10 ...
0
votes
1answer
21 views

Indexing a page in which the content is discovered in a map

We want to improve our site's SEO. The page is a GWT (javascript based) web page and its content is discovered through a map or a GPS. Now we have just a normal landing html page, and the map and ...
0
votes
1answer
48 views

Google news sitemap to many URLs

I created a Google news sitemap a while ago then about 6 months ago limited it to about 15 news items. The trouble is it seems Google has indexed over a 1000 items and is complaining the sitemap has ...
0
votes
2answers
368 views

Google stopped indexing my site. Is there a substitute for a XML sitemap?

On my site is a page that hosts all my ad entries. Each URL and its content is different. Google was indexing all the different URLs until entry 4570. As I can see in GWT Google Index they also ...
0
votes
1answer
396 views

1000 page submit limit in Google Webmaster Tools sitemap

I'm currently managing Webmaster Tools for some Wordpress sites and I'm curious as to why none of the sites are showing more than 1000 pages submitted. Some of the sites are much larger but I can't ...
0
votes
1answer
113 views

SoLoMo landingpage localized regionalized down to cities and SEO sitemap.xml

I'm working on an SoLoMo (social local mobile) web application. How would you realize the site and the landingpages that they are seo and crawler friendly? Any best-practises out there? I know there ...
0
votes
1answer
187 views

403 Error Crawling Pages

I am receiving more than 6000 errors in Google Webmaster Tools. It is showing "access denied"; can anyone please help me out with resolving this?
0
votes
1answer
235 views

Visual sitemap generater [closed]

I'm looking for a something to visually create a sitemap for one of my websites. Id like something in a tree structure, so I have the hierarchical view of my site. A couple requirements I have ...
0
votes
1answer
278 views

mod_rewrite and SEO friendliness

My website has an atypical structure and I'm not sure if this could create problems in the long run, specially for SEO positioning purposes. I have a unique, large PHP script, and I use the Apache ...
0
votes
2answers
94 views

Which kind of public sitemap should I build for a search based navigation site

I have a search based navigation web-site. Each query has filters as well as sort-by. The search results point to end-pages inside the site. Each of those pages has many outlinks to other end-pages. ...
0
votes
1answer
324 views

.XML Sitemaps and HTML Sitemaps Clarification

I've got a website with about 170 pages and I want to create an effective Sitemap for it as it is long due. The website is internally linked very well but I still want to take advantage of creating a ...
0
votes
1answer
1k views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
0
votes
2answers
2k views

How to control what appears on google search results?

So I have just built a site and all is well... but I want to control what appears on google search results. Lets say I google for "thefwa", first what comes is the link to www.thefwa.com, then ...
0
votes
1answer
84 views

Sitemap and url are laid out differently from each other

There is a website and the layout looks something like below: home->approved-> education entertainment business | ...
0
votes
1answer
105 views

Specifying crawlers to not crawl Links which are dependent on external API's

I have links on my site which lead to internal pages that depend on first bringing data from an external API. This only takes time the first time they are pushed. Links to pages which exists in the ...