Tagged Questions

A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
1answer
96 views

Google say: robots.txt not valid for subdomains?

I'm very confused about Google's robots.txt documentation Examples of valid robots.txt URLs: Not valid for http://other.example.com/ https://example.com/ http://example.com:8181/ ...
1
vote
1answer
70 views

Why I see my page sitemap XML link in Google?

I am using Yoast SEO plugin for my WordPress website. I am also using Yoast's XML Sitemap. Today I checked my pages in Google and found this indexed by Google: Title: http://example.com/ ...
6
votes
2answers
162 views

Submit example.com/#!/page URLs to Google

On a HTML5 website, there is a single page, index.php . Its code contains other 5 pages. An AJAX navigation is used, so the URL of other page looks like example.com/#!/page_Example. I had tried to ...
6
votes
1answer
110 views

If a website is accessed on HTTPS instead of HTTP, should the URLs on the sitemap be HTTPS or HTTP?

I have changed my website from HTTP to HTTPS. At this moment, I have the next rewrite rule working to redirect calls for HTTP to HTTPS: RewriteEngine On RewriteCond %{SERVER_PORT} 80 RewriteRule ...
1
vote
1answer
226 views

Flat vs. Hierarchical Tree Structure (vol. 2)

This relevant question deals with whether a site URL structure is better (SEO-wise) to be flat or hierarchical. How much important is it for a site ranking if the overall structure is flat or ...
1
vote
1answer
35 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
54 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: ...
3
votes
1answer
185 views

Can I have HTML link element both in headers and sitemap?

For a multilingual site In my sitemap I am using: <url> <loc>http://www.xxxx/en</loc> <changefreq>daily</changefreq> <xhtml:link rel="alternate" hreflang="en" ...
1
vote
3answers
73 views

Is it necessary to link to all landing pages from the homepage?

What I am wanting to do is build quite a few landing pages targeting specific keywords from google search. These pages will give a brief explanation of what we do and how we can help them with what ...
2
votes
2answers
93 views

Submitting sitemaps with 2 different websites but the same content

I have two domains running on the same server with the same IP (same content). For example: the sitemap of example1.com represents one website and method1.com, method2.com represent many pages will ...
0
votes
2answers
116 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
1
vote
1answer
21 views

Sitemap for WordPress extension

I'm using an extension to integrate a WordPress blog into my eCommerce site. WordPress is installed in its own directory with a link called blog on my home page. I used a free extension to do this. ...
0
votes
1answer
103 views

Is there any reason to add pagination to sitemap?

Let's say I have the following site structure: root category1 item1 item2 .... item99 category2 item101 item102 .... item199 ... Each category page contain ...
4
votes
1answer
112 views

Is it OK to submit the sitemap file to Google without pointing one in the Webmaster Tools?

I'd like to create several sitemaps and gather them into one sitemap index. Then I'd like to submit the sitemap index to Google (and other SE's) using those links. From my point of view it should be ...
1
vote
1answer
47 views

If the size of sitemap is limited: how do I tell to Google all of my URLs?

I heard that the sitemap for Google can not exceed 10 Mb and 50 kURLs. This is not enough for me. What shell I do to pass through this obstacle? Create sitemap for each category?
1
vote
2answers
74 views

Should pages linked to in my nav and footer be included in my sitemap?

I'm more of a back end developer and can't answer this question from my own research. When setting up the links in my sitemap, do I need to include the pages that I link to in my top navigation and ...
3
votes
3answers
313 views

Generate a sitemap automatically, does it need to be XML?

I want to create an XML sitemap (for the sake of SEO), my first attempt to achieve this was by including the website main menu/navigation links using <?php include ("assets/includes/menu.inc"); ...
2
votes
1answer
37 views

How often should a sitemap be rebuilt?

How often should a sitemap be rebuilt? Weekly, monthly? I'm curious about adding a dynamic sitemap thats generated weekly. Is that too often?
1
vote
2answers
42 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
2answers
52 views

Sitemap structure for network of subdomains

I am working on a project that's a network of 2 domains (domain.gr & domain.com.cy) of subdomains similar to Hubpages [each user gets a profile under a different subdomain & there is a ...
3
votes
1answer
46 views

SEO for Google: navigation, company info, video [duplicate]

I often stumble upon search results in Google that get a special treatment, like: having the site navigation (and more) being displayed on the search results page having a company's location, ...
1
vote
2answers
58 views

Do search engines rank URLs in sitemaps lower if there are no internal links pointing to them?

I have a site with thousands of pages. The pages are dedicated to be found by the search engines as they are very specific. It is very unlikely that the users will find necessary pages using any ...
2
votes
2answers
89 views

Sitemap specified in robots.txt not found by Google

I would like Google to find my sitemap.xml via robots.txt, rather than having to manually upload it. My robots.txt looks like this: User-agent: * Disallow: Sitemap: ...
2
votes
1answer
38 views

Regenerate sitemaps for every registered user?

I have a .Net website where the main functionality is viewing user profiles. Suppose if my URL to view a profile is www.mywebsite.com/viewprofile?id=20, to see a user with an id of 20. My question is ...
0
votes
0answers
11 views

Do I need to produce an xml sitemap for a social network? [duplicate]

I'm working on a social network that currently does not have an xml sitemap that has been submitted to Google Webmaster Tools. Will this add much benefit given that it is a social network with often ...
0
votes
3answers
64 views

Splitting a sitemap by content type

I currently am tasked with submitting our website sitemap to the search engines every week. We have a module which does offer sitemap generation but we find using it does not work very well as not ...
0
votes
1answer
34 views

WordPress and MediaWiki sitemap

I'm planning to make a WordPress site and include, also, a wiki, using MediaWiki. I know how to generate WP and MW sitemaps. Anyway, I think I need to merge the two sitemaps in some way. Am I right? ...
1
vote
1answer
953 views

Sitemap for a one-page site

I'm wondering whether it's worth the effort to create a sitemap for a single-page site. By single page I'm not talking about a webapp made with Angular or Backbone, just a presentation site/page ...
0
votes
0answers
7 views

Dynamically sitemap [duplicate]

I submitted to google webmasters my sitemap. I'm creating sitemap dynamically every day, it is just adding new links every day. Cause my site is news portal and every day we are adding news. So I'm ...
1
vote
2answers
55 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
1
vote
1answer
29 views

Removing items from a sitemap

I'm having a problem removing some unwanted links from my sitemap. The hierarchy which we have in the sitemap is incorrect. I don't want that be like that. Is there any way which I can change it? ...
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
0answers
8 views

How can my site show up on Google with last post date and secondary links? [duplicate]

How does one build a site to show up like this in the Google search results?
1
vote
1answer
66 views

Moved sitemaps to a different subdomain and losing search referrals around the same time. Red herring or correlation?

We started to lose search referral traffic around the same time that I moved some of our sitemaps to a subdomain. Could this have hurt us? I followed Google's steps to creating a sitemap under a ...
4
votes
1answer
383 views

Locate sitemap at HTTP or HTTPS?

Our homepage has a 301 redirect from HTTP to HTTPS but all other pages on the site are on HTTP. (1) Should the sitemap be located at HTTPS and is there any problem if we: (2) include the HTTPS ...
1
vote
1answer
142 views

Is there any advantage or disadvantage to add subdomain twice in search engines?

I have a domain (example.com) and some subdomains (e.g., sd1.example.com, ...). I added example.com to Google and Bing Webmaster Tools. I added example.com/sitemap and sd1.example.com/sitemap (with a ...
1
vote
1answer
176 views

Creating sitemap for Googlebot - how to mark dynamic content / dynamic subpages?

I have a website that is an Internet forum. This forum has many categories, and a single category page that contains a lot of subpages with listed threads. This Internet forum is brand new, and about ...
1
vote
1answer
109 views

How to check if a WordPress SEO plugin is working

I have setup my WordPress site with Yoast. However, it doesn't seem to appear in any of the search engines. In Google Webmaster Tools I don't see a sitemap. Is the plugin supposed to submit the ...
1
vote
1answer
107 views

Server gzip compression vs gzipped sitemap

My client's SEO guy said that search engines prefer gzipped sitemaps. They keep their sitemap in .xml.gz file. I was wondering if there is any difference for search engines between a gzipped ...
0
votes
1answer
158 views

Submitting vBulletin Sitemap to Google

I'm using Google Webmaster Tools to get my forum out there, and when I go to submit the sitemap I get the following error: Your Sitemap appears to be an HTML page. Please use a supported ...
0
votes
2answers
645 views

How does removing pages from a site affect Google SEO?

I have been told by one of my clients that Google must be notified if you intend to remove pages (e.g. discontinued product pages) from a site, because Google will penalize your search results if you ...
1
vote
1answer
72 views

What to do with discontinued product pages? [duplicate]

I have a site that reviews personal medical devices. Each year, these medical devices get replaced a few times by their newer/improved versions, so the old devices are not available anywhere ...
0
votes
0answers
34 views

Bing crawls my sitemap, but pages don't show in results [duplicate]

Before voting my question down, I must note that I have searched the forum. That being said: I have a sitemap, which is pretty large (25k pages). These are products for sale. The products are used ...
2
votes
1answer
328 views

Should I create a sitemap file and, if so, what should I add to it?

I submitted my website/app to Bing and Google recently. I subsequently received this email from bing: Dear Webmaster, This is a weekly report on the open issues categories we have detected on ...
1
vote
1answer
153 views

change sitemap after 301 redirect

when i use of 301 redirect for all URLs ... should i change sitemap URLs ??? ...... if Sitemap contains following URLs example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html should i ...
0
votes
1answer
226 views

Is it recommend to create sitemaps with query strings (i.e. URL parameters)?

I am considering creating a "My products" page on a site where a user will be able to search for product information. This page will also display the product information. I need google to know about ...
1
vote
1answer
43 views

Should I leave old events in my sitemap?

Should I leave old events in my sitemap that have passed, or remove them? The sitemap is quite huge and I didn't know if that was OK.
0
votes
1answer
62 views

insert multi post page in sitemap or not?

i want to insert below links in Sitemap, Each page has its own unique content : http://poetry.qrosh.com/en/William%20Shakespeare/A%20Fairy%20Song/1/1/ so if i have multi post pages which include 10 ...
0
votes
1answer
21 views

Indexing a page in which the content is discovered in a map

We want to improve our site's SEO. The page is a GWT (javascript based) web page and its content is discovered through a map or a GPS. Now we have just a normal landing html page, and the map and ...
11
votes
2answers
2k views

How to properly use Google Webmaster Tools (for “non-www” instead of “www”)

I'm trying to use Google Webmaster Tools correctly: I don't use the www in my website's URL, but just noticed that I must have entered the www when I originally added my site to Webmaster Tools a few ...