Tag Info

Hot answers tagged

14

In your header you have a canonical link (on line 11, just under <title>). It looks like this on your page: <link href="http://escene.ir/component/products/?task=view.12" rel="canonical" /> This element tells Google your preferred URL for a page which has several urls to choose from. This is to prevent you from being penalized for having ...


6

You are asking two questions here. Does a sitemap need to be XML? The simple answer is no, it doesn't have to be XML. It can be XML file, a text file or RSS/Atom feed (which is basically XML), HTML Sitemap HTML Sitemaps: These are used on your website to display the layout in layers on your website to any customer that would wish too (don't know why they ...


6

The sitemap should reflect the way pages should be accessed, if you want them to be accessed by HTTPS, then yes, that is what you have to do. Otherwise, you are just making the server work a bit extra each time it's crawled.


6

We have another question here that ask why items in the sitemap are not ranked better: The Sitemap Paradox. Google's John Mueller has this to say about common SEO misconceptions regarding sitemaps: The Sitemap file isn't meant to "fix" crawlability issues. If your site can't be crawled, fix that first. We don't use Sitemap files for ranking. ...


6

Most likely some part of your web site generated links like that, and that is how Google started to crawl the URLs. You should check the links in your web pages to see where these incorrect URLs are, and you should fix them. Also, you could change your Apache configuration so that requests for any other virtualhost than example.com or www.example.com would ...


5

The purpose of sitemaps is to tell the search engines about the pages in your website that you want them to crawl and index. If new pages are added to your site that you want crawled and indexed then they should be added to your sitemap. If this is occurring daily then you can add them daily. If this is occurring weekly then you can add them weekly. Search ...


5

Google does appear to index XML sitemaps (like any XML file). It seems that if Google is aware of a URL and it returns a valid response then it's likely to get indexed. Personally, I only submit the sitemap through GWT and include a Sitemap: reference in robots.txt and this is certainly enough to get it indexed. I believe the recommended method to prevent ...


5

Sitemaps serve to include, not limit the content Google indexes. If you want to exclude some files, use a robots.txt file as mentioned, or setup redirects. The reason this URL is included is likely that Google found a link pointing to it somewhere else. It could be on your site (which you can fix) or on a third-party site as incoming link. To figure that ...


4

A single XML sitemap should not contain a mix of HTTP and HTTPS URLs (i.e. essentially different locations as far as the search engines are concerned). So, the sitemap located at http://example.com/Sitemap.xml should only contain URLs starting http://example.com/ and similar for the HTTPS sitemap. From sitemaps.org: Q: My site has both "http" and ...


4

From https://support.google.com/webmasters/answer/156184?hl=en Sitemaps are a way to tell Google about pages on your site we might not otherwise discover. This means you don't need a sitemap if you don't want Google to discover anything. Having a sitemap won't do anything so I wouldn't make one at all.


4

http://zhanzhang.baidu.com/sitemap/index is the (sparse) documentation about sitemaps for Baidu. It only describes that it may help to submit your sitemap, and it shows a screenshot of their webmaster tool, listing several sitemaps and their status. However, it seems that they intend this feature only for "high quality" sites, on invitation basis. Here is ...


3

Sitemap files are a type of XML text file. Open the file with a text editor, remove the section that you don't want, and re-save the file. If you don't want the spider that crawled your site to generate that sitemap to put the pages in to begin with, you could edit your robots.txt file to block certain pages: User-Agent: * Disallow: ...


3

If you have two verified sites (verified in Webmaster Tools) means you can have a single sitemap. If you have multiple websites, you can simplify the process of creating and submitting Sitemaps by creating one or more Sitemaps that includes URLs for all your verified sites, and saving the Sitemap(s) to a single location. All sites must ...


3

You don't have to use GWT to make Google aware of an XML sitemap. It's just one of the ways they make available to webmasters but isn't the only way or a required way. You can use robots.txt to accomplish this as well.


3

As explained in this Google reference, the sitemaps listed in the robots.txt are not displayed in the Google Webmaster Tools. Was your Sitemap submitted using ping or robots.txt? Only Sitemaps submitted using Webmaster Tools are listed on the Sitemaps page. To make sure your Sitemap information is visible, it's a good idea to use Webmaster Tools to ...


3

According to Google, you should list your AJAX URLs in a sitemap exactly as you say you've done: "4. Consider updating your Sitemap to list the new AJAX URLs Crawlers use Sitemaps to complement their discovery crawl. Your Sitemap should include the version of your URLs that you'd prefer to have displayed in search results, so in most cases it would ...


3

You need to put a robots.txt in the root web directory of your subdomain, just like you do for your main domain. You have to think of the subdomain as a separate website in this case.


3

You should include to your sitemap all the URLs you want to see in a search engine's index.


3

Sitemaps are for telling search engines where to find your content, not your sitemaps. So you should not include your sitemap URL in your sitemap. (It would be redundant anyway).


3

Baidu has a Webmaster Tools application that is written in Chinese. But all is not lost. Here is a tutorial: http://www.webnots.com/baidu-webmaster-tools.html The tutorial is written in English and translates the options for you. I am not sure how up to date this is, but it does look complete otherwise and may be useful. I do not see that Baidu reads the ...


3

Ok. Found the answer at: Help Google serve the correct language to your visitors We need to have a url tag for each of the url and specify the others as alternate urls.


3

do you have a google webmaster tools account? if you create a free account with them and verify that you are the actual site owner then google will allow you to request for removal of a folder or specific urls. my personal experience is that search engines take the liberty of not following instructions but this step would at least remove your pages from ...


3

My answers: Search engines bots are web crawlers (like your web browser in some way) and when a 301 redirect is thrown, they are notified. Therefore, they follow the new redirect to reach the new page and know the PageRank must be transferred. If the 301 redirect is up, search engines don't crawl a.html anymore, that's why after a long time, they remove ...


3

No, you don't need to submit a sitemap for the version (here with www) you don't want to use. Remember submitting a sitemap to your Google Webmaster Tools account helps indexing of the site. Therefore, you submit a sitemap only for a site you want to see in Google's index.


2

Just add those pages to the sitemap. Otherwise you will just have to depend on Google to follow the links it finds on each subpage within /Forums/Physics. For such a large quantity of pages you will want this to be an automated process. This includes when new pages are added. StackOverflow and other large sites do this as it would be impossible to do ...


2

There is no difference between the two ways you describe of gzipping a sitemap.xml for search engines. The important thing is to just make sure your sitemap.xml is gzipped, to save bandwidth for website servers and search engines, even more if your sitemap.xml file size is big.


2

If you want those pages to be crawled and indexed then you should put them in your sitemap. The point of sitemaps is to tell the search engines about the pages on your website so if new members sign up their profile page should be added to the sitemap. Of course they don't have to be in the sitemap if they can be found through links within your website (or ...


2

I'm assuming you're referring to an XML Sitemap? If so, then no - the sole purpose of an XML sitemap is to facilitate in the discovery (for indexation) of URLs/Pages. So if you only have one page, then there's no point. If you're worried about being found by search engines, you can either link to your page (from another site, or a twitter/Google+ page), ...


2

Your first question is about Sitelinks. Google says that this process is entirely automated and see this question for more information about Sitelinks. Second one is about Data Highlighter - Local Businesses You can use Data Highlighter to tag data about your business, such as its name, address, customer reviews, and ratings. Then Google can ...


2

Just use Sitemap index files: You can provide multiple Sitemap files, but each Sitemap file that you provide must have no more than 50,000 URLs and must be no larger than 10MB (10,485,760 bytes). If you would like, you may compress your Sitemap files using gzip to reduce your bandwidth requirement; however the sitemap file once uncompressed must ...



Only top voted, non community-wiki answers of a minimum length are eligible