1
vote
2answers
30 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
0
votes
0answers
16 views

Site indexed in Google but not in Bing [duplicate]

I have a site, with an XML sitemap, that has tens of thousands of pages. Google's webmaster tools show that almost all fo the pages are indexed, but Bing's show that only about 300 pages are in the ...
4
votes
1answer
67 views

Webmaster tools show old URLs are crawled

We renewed our website last year (2012) in December. After that we have put 301 redirection in place for the required pages. We removed some pages in old site when we moved to new site. For example ...
1
vote
2answers
126 views

Sitemaps - do I need to submit each sitemap in sitemap_index.xml to Google Webmaster tools?

I am having a Wordpress blog on my CentOS server. There is no sitemap.xml in the root directory but there is sitemap_index.xml file in the root directory which contains the following code: ...
3
votes
0answers
38 views

What factors help in getting a site indexed by Google fast? [duplicate]

Possible Duplicate: What are the best ways to increase a site’s position in Google? What should I do to get a site indexed on Google, fast? Taking example of Super User I just did a quick ...
2
votes
1answer
94 views

How frequently Googlebot fetch sitemaps? Is it depending on PageRank?

How much frequently Google fetches sitemaps? I am now working with a high traffic website normally have 30 new posts per minute but currently it provides sitemaps which links to new 100 posts (3 ...
3
votes
1answer
89 views

Handling SEO for Infinite pages that cause external slow API calls

I have an 'infinite' amount of pages in my site which rely on an external API. Generating each page takes time (1 minute). Links in the site point to such pages, and when a users clicks them they are ...
1
vote
1answer
77 views

browse-able hierarchy vs. sitemap

The current site navigation is done through a search form. UX wise, I feel it's the best solution we can currently offer our uses. Because this is the case, I have a sitemap that covers all the pages ...
3
votes
3answers
461 views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
0
votes
1answer
247 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
1
vote
2answers
405 views

Why does google crawl my page only once even I set changefreq:daily?

I have built a new site, submitted my homepage URL to Google, and my sitemap(I have about 6,300 pages.). Now when I type site:mydomain.com, there have 1,992 pages have crawled. But they were all ...
0
votes
2answers
115 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
1
vote
1answer
207 views

ampersand (&) sign in sitemap generating error

I have ampersand sign in urls and Google is not able to parse my sitemap.xml due to this. I can't remove the sign but i have to submit my xml to google. Is there any solution for this.
3
votes
3answers
167 views

How sitemap.xml influences indexation?

If a page is missing in sitemap.xml (but crawable through HTML hyperlinks), may this cause it not to be indexed? (I mean it would be indexed without sitemap, but not indexed with sitemap because it is ...
1
vote
1answer
155 views

Google Sitemap Limits?

I've read in multiple places that Google's sitemap limits sits at 50,000 URLs per sitemap - though it's my understanding that you can submit multiple sitemaps to overcome this problem. I've also ...
2
votes
2answers
147 views

Will ranking be affected with a mobile XML sitemap for a mobile site with the same URLs as the desktop site?

We have a site with both a desktop version and a mobile version. Most of the content are the same and both versions have the same URL, but the HTML generated is device specific. Looking at Google's ...
0
votes
1answer
390 views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
3
votes
2answers
331 views

Update Google Sitemap for Mobile

I have a series of utilities to generate Google sitemaps for my whole site. These files are massive, and slow to build. We want to start telling Google these pages are mobile-crawl-able too, by ...
1
vote
2answers
208 views

Creating Google sitemap.xml , is it okay for the images to be wrapped in url tags?

I'm using a tool to generate the sitemap.xml file for me, it started to crawl my website, got the pages and all images, but when exporting it, I review the xml(to make sure nothing is wrong) and I ...
0
votes
1answer
527 views

google image sitemap title and caption, which is more important?

here is the document about google image sitemap, But <image:caption> and <image:title>, which is more important? if i have only one description of this image, which part is better to be ...
1
vote
3answers
429 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
3
votes
2answers
233 views

Frequency to submit sitemap to search engines

i have went live with my site and being new to search engines and SEO fields not sure what should be the best way to handle sitemap.xml. I have created sitemap.xml and submitted it to Google using ...
0
votes
0answers
191 views

Why is <my site url> not indexed by search engines? [closed]

was indexed fine until about a year ago. The only thing I can think of is that search engines throw up at using h5 before h4, or that some person (fantasizing now) has reported my site as unsafe to ...
0
votes
2answers
387 views

Google sitemap for dynamic url structure

I am wondering what the best approach would be to generating a sitemap for google to crawl with a highly dynamic url structure. We have a webapp that assigns custom uris to all the users in our ...
1
vote
2answers
485 views

Google Webmaster Tools URLs in the index differ from the sitemap. How comes?

Google Webmaster Tools says ~14000 URLs in the index but as you can see in the following picture there are only ~6500 from the sitemap. How comes? I mean: my website is not properly "crawl-able". So ...
0
votes
2answers
1k views

How to control what appears on google search results?

So I have just built a site and all is well... but I want to control what appears on google search results. Lets say I google for "thefwa", first what comes is the link to www.thefwa.com, then ...
2
votes
6answers
364 views

Sitemap tool fails to find all URLs in my site

I added my url to Google http://www.google.com/addurl.html I added a meta tag with description and keywords I added it in Google web master tools and submit the site map There is no any robots in my ...
0
votes
3answers
131 views

Google is not indexing the entirety of my site [duplicate]

I require google to index the entirety of my site: 10 or so basic sections with 80,000+ individual job offer pages. However, to date, only 2,900 pages have been indexed by google. I'd like to know ...
1
vote
2answers
117 views

Robots.txt and sitemaps

If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in the xml sitemap or not? Edit: If i ...
1
vote
1answer
395 views

ASP.NET MVC SEO friendly URLs and Sitemap

I've created an ASP.NET MVC 3 application and generated sitemap.xml using some free online tools. It contains the following URLs: http://www.mydomain/ http://www.mydomain/About ...
2
votes
2answers
284 views

Why sitemap gives higher priority to category and archive pages?

I am using wordpress along with Google (XML) Sitemap Generator Plugin, and have got a question about sitemap priorities. By default, The plugin gives higher priority to category, tag and archive ...
1
vote
1answer
242 views

Sitemap vs nofollow

I have a sitemap on my site, which includes all users from the site. On the user profile page, tho, I don't want google to index all users, only those with more than 10 posts, so I've added a meta ...
1
vote
1answer
331 views

Problem with Google indexing URLs in my XML SiteMap

My XML sitemap has a lot of links - for example: nanoc.gigfa.com/post.php?id=1 nanoc.gigfa.com/post.php?id=2 nanoc.gigfa.com/post.php?id=3 nanoc.gigfa.com/post.php?id=4 ...
3
votes
1answer
376 views

Can a sitemap index contain other sitemap indexes?

I have a bi-lingual website with a sitemap index for each language that links to several different sitemaps (one for videos, one for static content, and one for articles). I would like to introduce ...
2
votes
1answer
75 views

how do i tell google that my landing page is a blog?

I have written my own very simple CMS and everything i publish on my page will go on the landing page (http://xyious.com). so every time i write a new page, regardless of where it ends up on the ...
7
votes
4answers
411 views

Is it possible to 'trigger' indexing on a site?

We're launching a redeveloped site soon. Google has already indexed the site that we're going to replace, but the links that google indexed are no longer applicable, because the new site has a totally ...
2
votes
2answers
143 views

Will this sitemap get me de indexed from Google?

My site's URL (web address) is: http://quantlabs.net/private/sitemap.xml Description (including timeline of any changes made): Will this sitemap get me de-indexed from Google? My new site map just ...
3
votes
6answers
1k views

How to tell Google that I have changed my website URLs?

I have done major updates to my website, and renamed all my URLs. How can I tell Google that I have renamed these URLs and let Google refresh its index? My website URL: http://www.pndmasr.com/ My ...
0
votes
1answer
236 views

Google Search to link to a Query String

How to get Google Search to link to a Query String for your page when no physical page Exist. I notice when I do a google search for some keywords I get back some website hits that do not link to a ...
2
votes
1answer
89 views

Do or don't submit the comment-feed of your blog?

A commentsfeed (of a blog) might serve perfectly as a commentssitemap. I'm wondering if it's a good idea to submit this feed to Google's webmaster tools. What are the pros & cons?
1
vote
0answers
125 views

How does Stack Overflow have questions appear in Google so quickly? [duplicate]

Possible Duplicate: StackOverflow and Google search I have noticed while asking questions on Stack Overflow that they appear in Google almost instantly. How does SO do this? Is it a feed ...
4
votes
2answers
1k views

Google doesn't seem to update the description or title of my homepage

Before we launched our website, we had set up a "coming soon" page and google picked up the title and description from its contents. So the description in the search results said, "Coming soon! Visit ...
0
votes
0answers
101 views

Is there a way that is more efficient than sitemap to add/force recrawl/remove your website's index entries in google? [duplicate]

Possible Duplicate: StackOverflow and Google search I'll make it more simple: Right now I am posting this question, after a minute or two... may be it will appear on google search query: ...
0
votes
1answer
83 views

is there anything wrong with my sitemap.xml

I had written an article over Highly searched keywords some days ago. When i search it in google using top searched keywords article-stack, it returns many results from my site. But none of them was ...
2
votes
1answer
161 views

Sitemap contains a lot of products and web index contains a few according to Google webmaster tools

Our sitemap has something like 10 million pages: This is the data in the webmaster tools: Submitted URLs 10,873,781 2 URLs in web index. This is a big difference and an incorrect statement, since ...
3
votes
2answers
333 views

sitemap that contains millions of links/URLs

I am currently working on a shopping / auction website. The involving party who's doing SEO consultancy is insisting to generate URLs for every single combination of products listed on the website, ...
5
votes
1answer
432 views

Sitemap XML version vs simple text (urls list) version, do you know what are the pros?

I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :) ...
149
votes
18answers
21k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
17
votes
6answers
4k views

Why did Google stop indexing pages from our sitemap.xml?

We're seeing some pages that exist in our sitemap.xml but are inexplicably missing from Google's public search index. You can't download http://superuser.com/sitemap.xml -- we protect this file ...
9
votes
1answer
234 views

using multiple sitemaps in a domain

I have a domain http://sub.example.com/. In it there is a wordpress blog at http://sub.example.com/blog and other more static content at http://sub.example.com/other, http://sub.example.com/stuff, ...

1 2