0
votes
1answer
31 views

Cleanup incorrectly indexed subdomains due to wildcard DNS

I have site www.example.com which someone previously configured with wildcard DNS records and with no 301 redirects. As you may have expected, Google's index is now full of garbage like w.example.com, ...
1
vote
2answers
91 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
0
votes
1answer
68 views

google webmaster tools, site maps and indexing, number of pages indexed reduces with no new sitemap

It seems to take two weeks ish to get updates on to the google index, which seems fair enough as I imagine googles index of the whole internet could be rather large. However, the some changes to my ...
5
votes
5answers
357 views

How can I fix Google indexing URLs that are not part of my sitemap?

Using site:example.com in Google is returning many results with the following format: https://www.w.example.com/services/edison/16mm-to-2k Obviously this is not what I submitted and is not part of my ...
1
vote
1answer
38 views

Google not indexing new forum

We installed a new forum a few months ago now. The URL is: https://www.scirra.com/forum I've 301'd the old topics/threads, as well as included all the new URLs in the sitemap. Yet they still are ...
2
votes
1answer
52 views

Google sitemap HrefLang tag without the main site url

We have websites with multilingual content. e.g. http://www.example.com/about-us/ http://www.example.com/en-HK/about-us/ http://www.example.com/en-GB/about-us/ ...
0
votes
1answer
56 views

Website with over 1 million posts with not much textual content

I've made a website which crawls files from all over the Internet and I feel like Google will ban me if I sent it sitemaps which contain all of these pages (1m+), because they contain only the file ...
6
votes
4answers
278 views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
2
votes
1answer
56 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
10
votes
2answers
751 views

Google is changing my urls in search results - Joomla3 bug

My urls is something like escene.ir/component/products/تلفن-های-تحت-شبکه-مدیریتی/Escene-ES620-PEN-IP-Phone?task=view.12 but when I try to search site:escene.ir to see the whole links of my site, ...
1
vote
4answers
124 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
0
votes
2answers
50 views

Google has indexed our archives

Upon first submitting our sitemap, we didn't take into account the index of archive pages. With 50,000 articles, we're seeing lots of archive pages results (i.e. News (Page 40 of 876)) Since then ...
0
votes
0answers
39 views

Google video sitemap with lighttpd

I have over 10k videos hosted on my server, and I'm using lighttpd to switch the video URLs every 2 hours because of hotlinking protection. This means that all video URLs in video sitemap is only ...
6
votes
2answers
155 views

Submit example.com/#!/page URLs to Google

On a HTML5 website, there is a single page, index.php . Its code contains other 5 pages. An AJAX navigation is used, so the URL of other page looks like example.com/#!/page_Example. I had tried to ...
4
votes
1answer
111 views

Is it OK to submit the sitemap file to Google without pointing one in the Webmaster Tools?

I'd like to create several sitemaps and gather them into one sitemap index. Then I'd like to submit the sitemap index to Google (and other SE's) using those links. From my point of view it should be ...
1
vote
1answer
42 views

If the size of sitemap is limited: how do I tell to Google all of my URLs?

I heard that the sitemap for Google can not exceed 10 Mb and 50 kURLs. This is not enough for me. What shell I do to pass through this obstacle? Create sitemap for each category?
3
votes
1answer
46 views

SEO for Google: navigation, company info, video [duplicate]

I often stumble upon search results in Google that get a special treatment, like: having the site navigation (and more) being displayed on the search results page having a company's location, ...
0
votes
0answers
7 views

Dynamically sitemap [duplicate]

I submitted to google webmasters my sitemap. I'm creating sitemap dynamically every day, it is just adding new links every day. Cause my site is news portal and every day we are adding news. So I'm ...
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
0answers
8 views

How can my site show up on Google with last post date and secondary links? [duplicate]

How does one build a site to show up like this in the Google search results?
0
votes
2answers
570 views

How does removing pages from a site affect Google SEO?

I have been told by one of my clients that Google must be notified if you intend to remove pages (e.g. discontinued product pages) from a site, because Google will penalize your search results if you ...
0
votes
0answers
34 views

Bing crawls my sitemap, but pages don't show in results [duplicate]

Before voting my question down, I must note that I have searched the forum. That being said: I have a sitemap, which is pretty large (25k pages). These are products for sale. The products are used ...
0
votes
1answer
192 views

Is it recommend to create sitemaps with query strings (i.e. URL parameters)?

I am considering creating a "My products" page on a site where a user will be able to search for product information. This page will also display the product information. I need google to know about ...
0
votes
1answer
44 views

Google news sitemap to many URLs

I created a Google news sitemap a while ago then about 6 months ago limited it to about 15 news items. The trouble is it seems Google has indexed over a 1000 items and is complaining the sitemap has ...
0
votes
2answers
333 views

Installing Google Sitemap Generator on Linux

I have a website with httpd (front end) and Apache tomcat (back end). I'm trying to install Google Sitemap Generator and create sitemap for the website. I followed the following link for ...
1
vote
1answer
385 views

My Domain Name Appears Twice in Most of My URLs

I've recently been adding some backlinks to other articles within my site. I don't know if it's this that is now causing me a problem. I now notice that Google has indexed my sites pages again but ...
5
votes
2answers
256 views

Which pages from the sitemap are not indexed by Google?

I have a sitemap file that has been submitted to Google, and has been processed, according to Google Webmaster Tools. As per GWT for 2013-05-31, 8255 web-pages are submitted, but only 8209 are ...
1
vote
2answers
234 views

Sitemap indexed count and Google results difference

My sitemap claims they have indexed over 3 thousand pages from it but when i do a site command in Google site:http://domain.com It returns 200 pages. I have heard of the sitemap index count ...
1
vote
2answers
67 views

Is cloaking of sitemap.xml permitted?

I have a scenario where my sitemaps are generated when visiting /sitemap.xml due to the contents being dynamic in nature. For that reason I'd like to not call the services that are used to create my ...
4
votes
1answer
136 views

Webmaster tools show old URLs are crawled

We renewed our website last year (2012) in December. After that we have put 301 redirection in place for the required pages. We removed some pages in old site when we moved to new site. For example ...
2
votes
2answers
393 views

Sitemaps - do I need to submit each sitemap in sitemap_index.xml to Google Webmaster tools?

I am having a Wordpress blog on my CentOS server. There is no sitemap.xml in the root directory but there is sitemap_index.xml file in the root directory which contains the following code: ...
3
votes
0answers
38 views

What factors help in getting a site indexed by Google fast? [duplicate]

Possible Duplicate: What are the best ways to increase a site’s position in Google? What should I do to get a site indexed on Google, fast? Taking example of Super User I just did a quick ...
6
votes
2answers
224 views

How frequently does Googlebot fetch sitemaps? Does it depend on PageRank?

How frequently does Google fetch sitemaps? I am now working with a high traffic website that normally has 30 new posts per minute. It currently it provides a sitemap which only includes the 100 ...
5
votes
1answer
110 views

Handling SEO for Infinite pages that cause external slow API calls

I have an 'infinite' amount of pages in my site which rely on an external API. Generating each page takes time (1 minute). Links in the site point to such pages, and when a users clicks them they are ...
1
vote
1answer
95 views

browse-able hierarchy vs. sitemap

The current site navigation is done through a search form. UX wise, I feel it's the best solution we can currently offer our uses. Because this is the case, I have a sitemap that covers all the pages ...
5
votes
3answers
1k views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
0
votes
1answer
355 views

How to secure robots.txt file?

I would like for User-agents to index my relative pages only without accessing any directory on my server. As initial thought, i had this version in mind: User-agent: * Disallow: */* Sitemap: ...
1
vote
2answers
648 views

Why does google crawl my page only once even I set changefreq:daily?

I have built a new site, submitted my homepage URL to Google, and my sitemap(I have about 6,300 pages.). Now when I type site:mydomain.com, there have 1,992 pages have crawled. But they were all ...
0
votes
2answers
205 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
1
vote
1answer
599 views

ampersand (&) sign in sitemap generating error

I have ampersand sign in urls and Google is not able to parse my sitemap.xml due to this. I can't remove the sign but i have to submit my xml to google. Is there any solution for this.
3
votes
4answers
242 views

How sitemap.xml influences indexation?

If a page is missing in sitemap.xml (but crawable through HTML hyperlinks), may this cause it not to be indexed? (I mean it would be indexed without sitemap, but not indexed with sitemap because it is ...
1
vote
1answer
339 views

Google Sitemap Limits?

I've read in multiple places that Google's sitemap limits sits at 50,000 URLs per sitemap - though it's my understanding that you can submit multiple sitemaps to overcome this problem. I've also ...
4
votes
3answers
212 views

Will ranking be affected with a mobile XML sitemap for a mobile site with the same URLs as the desktop site?

We have a site with both a desktop version and a mobile version. Most of the content are the same and both versions have the same URL, but the HTML generated is device specific. Looking at Google's ...
0
votes
1answer
992 views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
3
votes
2answers
653 views

Updating Google sitemap for mobile

I have a series of utilities to generate Google sitemaps for my whole site. These files are massive, and slow to build. We want to start telling Google these pages are mobile-crawl-able too, by ...
1
vote
2answers
321 views

Creating Google sitemap.xml , is it okay for the images to be wrapped in URL tags?

I'm using a tool to generate the sitemap.xml file for me, it started to crawl my website, got the pages and all images, but when exporting it, I review the XML (to make sure nothing is wrong) and I ...
0
votes
1answer
1k views

google image sitemap title and caption, which is more important?

here is the document about google image sitemap, But <image:caption> and <image:title>, which is more important? if i have only one description of this image, which part is better to be ...
1
vote
3answers
791 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
0
votes
2answers
632 views

Google sitemap for dynamic url structure

I am wondering what the best approach would be to generating a sitemap for google to crawl with a highly dynamic url structure. We have a webapp that assigns custom uris to all the users in our ...
1
vote
2answers
628 views

Google Webmaster Tools URLs in the index differ from the sitemap. How comes?

Google Webmaster Tools says ~14000 URLs in the index but as you can see in the following picture there are only ~6500 from the sitemap. How comes? I mean: my website is not properly "crawl-able". So ...