A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
1answer
17 views

How to instruct Google to crawl old, non-linked pages?

I am working on a website for a client who wants to launch with at least 2,000 articles, where in terms of links not all 2,000 articles will of course be available on the homepage or elsewhere. But, ...
1
vote
1answer
35 views

changing URL format afftects SEO reputation and not considering 301 redirection

We had URL http://www.example.com/category/subcategory.html which changed to http://www.example.com/category/filter/cat/subcategory.html We did 301 redirection, updated canonical URL to new one also ...
1
vote
2answers
48 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
4
votes
2answers
44 views

Is it necessary to submit sitemap to www and non www?

I have submitted my website to Google Webmaster Tools with both www and with no-www. I had made the domain without www to my preffered domain and have submitted a sitemap. My question is should I ...
2
votes
1answer
39 views

When 301 redirecting a page, what needs to be in the sitemap?

In sitemap there was page a.html which has some PageRank. Now a.html is redirecting to b.html using 301 and sitemap has b.html entry, a.html is removed. Queries are: As a.html is not in sitemap ...
2
votes
1answer
23 views

Yahoo sitemap ping URL?

We recently used the URL: http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=YahooDemo&url=.... To ping Yahoo about sitemap changes. This URL turned out to time out and ...
0
votes
1answer
10 views

What resolution in sitemap.xml image attribute?

I'm just creating a sitemap for my page and I found these aspects for creating it on Google: https://support.google.com/webmasters/answer/183668 There is a attribute for images, but my question is: ...
2
votes
1answer
40 views

Google not indexing video from video sitemap

I run a website serving video content. I run my own player. I have added Google’s structured markup to the video tags. Here’s the link to test a page. I also have the sitemap pointing to a ...
0
votes
1answer
25 views

Which search engines prefer an HTML sitemap over an XML sitemap?

Is there a search engine out there that prefers a full HTML sitemap over an XML one? On a site with thousands of articles, does it make sense to include a page that has links to every single page?
0
votes
1answer
43 views

google webmaster tools, site maps and indexing, number of pages indexed reduces with no new sitemap

It seems to take two weeks ish to get updates on to the google index, which seems fair enough as I imagine googles index of the whole internet could be rather large. However, the some changes to my ...
1
vote
1answer
37 views

What is the meaning of this sitemap error in Google Webmaster Tools?

In my Google Webmaster Tools, I received an error which I am not understanding: When we tested a sample of the URLs from your Sitemap, we found that some of the URLs were unreachable. Please check ...
5
votes
5answers
338 views

How can I fix Google indexing URLs that are not part of my sitemap?

Using site:example.com in Google is returning many results with the following format: https://www.w.example.com/services/edison/16mm-to-2k Obviously this is not what I submitted and is not part of my ...
1
vote
1answer
32 views

Can I submit multiple domain sitemaps in Google Webmaster Tools?

My site is setup in Blogger with a custom domain name. Currently, url.blogspot.com is 301 redirected/forwarded to www.url.mydomainname.com. The naked domain mydomainname.com is returning a 404 status ...
0
votes
1answer
40 views

Should I include different types of result listing pages in my xml sitemap?

Say I have an articles section. It can be filtered by tag (/articles/tag/detectives), by author (/articles/author-url) and also through regular pagination, with the recent first (/articles?page=2). ...
1
vote
1answer
31 views

Google not indexing new forum

We installed a new forum a few months ago now. The URL is: https://www.scirra.com/forum I've 301'd the old topics/threads, as well as included all the new URLs in the sitemap. Yet they still are ...
1
vote
1answer
21 views

Google sitemap HrefLang tag without the main site url

We have websites with multilingual content. e.g. http://www.example.com/about-us/ http://www.example.com/en-HK/about-us/ http://www.example.com/en-GB/about-us/ ...
0
votes
1answer
54 views

Website with over 1 million posts with not much textual content

I've made a website which crawls files from all over the Internet and I feel like Google will ban me if I sent it sitemaps which contain all of these pages (1m+), because they contain only the file ...
5
votes
3answers
166 views

Is submitting a sitemap an outdated technique for SEO?

I'm not getting more content or recommendations for sitemap practice in SEO. Is submitting a sitemap an outdated practice in SEO or is it necessary to submit a sitemap for SERP?
1
vote
1answer
66 views

Creating more than one sitemap and relating it to a subdomain - will I be penalized?

I'm thinking in creating a subdomain containing all the reviews from my products, for example: http://reviews.mystore.com At this subdomain, I have my sitemap.xml pointing for the reviews page about ...
6
votes
4answers
128 views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
1
vote
2answers
46 views

Need to encourage google to refresh robots.txt [duplicate]

My old robots.txt is User-agent: * Disallow: / Is blocking me for uploading a new sitemap and also blocking me for fetching robots.txt manually. I don't know what to do.
3
votes
3answers
44 views

Indexed webpages stopped rising, while Submited keep rising normally

Last months I have noticed a strange behaviour in Google's Webmaster Tools. Although I provide a valid Sitemap for my website, which is normally processed and without any issues from Google, while ...
2
votes
1answer
52 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
9
votes
2answers
724 views

Google is changing my urls in search results - Joomla3 bug

My urls is something like escene.ir/component/products/تلفن-های-تحت-شبکه-مدیریتی/Escene-ES620-PEN-IP-Phone?task=view.12 but when I try to search site:escene.ir to see the whole links of my site, ...
1
vote
3answers
85 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
0
votes
2answers
50 views

Google has indexed our archives

Upon first submitting our sitemap, we didn't take into account the index of archive pages. With 50,000 articles, we're seeing lots of archive pages results (i.e. News (Page 40 of 876)) Since then ...
0
votes
2answers
104 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
5
votes
2answers
222 views

How to submit sitemap to Baidu?

I've some pages in my site in Chinese but I don't understand Chinese (it's some GIS data). Is there any way to submit sitemap to Baidu?
1
vote
2answers
39 views

Is it ok to include sitemap URL in sitemap.xml

Does it have sense to include sitemap URL into sitemap? It is pointing to itself and in SEO perspective it's no use because if crawler is on our sitemap he already knows it, no need to inform it, ...
1
vote
2answers
53 views

HTML Sitemap URL format

When adding a html sitemap to a site, for SEO purposes should the links it contains be locally referenced or is it better to use the full URL? Eg: <ul> <li><a ...
1
vote
2answers
83 views

Do Google sitemap URLs need to be double urlencoded?

Do Google sitemap URLs need to be double urlencoded? I am submitting my sitemaps to Google and Google is having difficulty navigating to URLs that contain urlencoded characters. An example of a ...
2
votes
1answer
79 views

Should paginated sites be included in sitemap?

My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com). There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination: added ...
0
votes
0answers
35 views

Google video sitemap with lighttpd

I have over 10k videos hosted on my server, and I'm using lighttpd to switch the video URLs every 2 hours because of hotlinking protection. This means that all video URLs in video sitemap is only ...
0
votes
3answers
26 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
2
votes
1answer
272 views

Incorrect rel-alternate-hreflang implementation

Google Webmaster Tools advised the following to us: We have noticed that on a number of the pages on your site the rel-alternate-hreflang implementation is incorrect. In particular, there ...
2
votes
1answer
117 views

What is the correct format and attributes for adding a PDF to an XML sitemap?

I have found numerous questions and blogs about including PDF files in an XML sitemap but cannot find a single one that gives a working example or which attributes to use: What document types can be ...
5
votes
1answer
57 views

If I use the same image on multiple pages, should it be on my sitemap multiple times?

Following Google's guide to Image sitemaps <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" ...
0
votes
1answer
55 views

Google say: robots.txt not valid for subdomains?

I'm very confused about Google's robots.txt documentation Examples of valid robots.txt URLs: Not valid for http://other.example.com/ https://example.com/ http://example.com:8181/ ...
1
vote
1answer
64 views

Why I see my page sitemap XML link in Google?

I am using Yoast SEO plugin for my WordPress website. I am also using Yoast's XML Sitemap. Today I checked my pages in Google and found this indexed by Google: Title: http://example.com/ ...
6
votes
2answers
132 views

Submit example.com/#!/page URLs to Google

On a HTML5 website, there is a single page, index.php . Its code contains other 5 pages. An AJAX navigation is used, so the URL of other page looks like example.com/#!/page_Example. I had tried to ...
6
votes
1answer
86 views

If a website is accessed on HTTPS instead of HTTP, should the URLs on the sitemap be HTTPS or HTTP?

I have changed my website from HTTP to HTTPS. At this moment, I have the next rewrite rule working to redirect calls for HTTP to HTTPS: RewriteEngine On RewriteCond %{SERVER_PORT} 80 RewriteRule ...
1
vote
1answer
115 views

Flat vs. Hierarchical Tree Structure (vol. 2)

This relevant question deals with whether a site URL structure is better (SEO-wise) to be flat or hierarchical. How much important is it for a site ranking if the overall structure is flat or ...
1
vote
1answer
32 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
52 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: ...
3
votes
1answer
142 views

Can I have HTML link element both in headers and sitemap?

For a multilingual site In my sitemap I am using: <url> <loc>http://www.xxxx/en</loc> <changefreq>daily</changefreq> <xhtml:link rel="alternate" hreflang="en" ...
1
vote
3answers
72 views

Is it necessary to link to all landing pages from the homepage?

What I am wanting to do is build quite a few landing pages targeting specific keywords from google search. These pages will give a brief explanation of what we do and how we can help them with what ...
2
votes
2answers
81 views

Submitting sitemaps with 2 different websites but the same content

I have two domains running on the same server with the same IP (same content). For example: the sitemap of example1.com represents one website and method1.com, method2.com represent many pages will ...
0
votes
2answers
80 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
1
vote
1answer
19 views

Sitemap for WordPress extension

I'm using an extension to integrate a WordPress blog into my eCommerce site. WordPress is installed in its own directory with a link called blog on my home page. I used a free extension to do this. ...
0
votes
1answer
50 views

Is there any reason to add pagination to sitemap?

Let's say I have the following site structure: root category1 item1 item2 .... item99 category2 item101 item102 .... item199 ... Each category page contain ...