A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

0
votes
0answers
11 views

Google isn't crawling all Sitemap URLs [duplicate]

Googlebot isn't indexing our Sitemap http://i.stack.imgur.com/WkB1J.png There are 63 links in the Sitemap only two are indexed I've tried sending some link to the index by "fetch as Google" with no ...
1
vote
1answer
24 views

Is it bad practice to have “parent” sitemap name inconsistent with “child” sitemaps?

My client is using the Fitpro Theme for WordPress which comes with predefined post types i.e fitness_class. However he wanted it changed to "classes" for the permalink and seo reasons. So I made the ...
1
vote
1answer
33 views

Include “www” in sitemap URL in robots.txt when site redirects to no-www?

Website is redirected to remove the www so www.example.com is redirecting to example.com. Question is do I need to include the www in the sitemap for the robots.txt?
1
vote
0answers
19 views

I have two websites , one has over 8000 pages indexed the other has less than hundred,why is this happening? [closed]

Both sites were created with the same platform and have similar layout , their age is only a few days apart but one site is having problem getting indexed above 120pages out of the 18000+. I have ...
1
vote
0answers
42 views

Google search console reports URLs blocked by robots.txt even though they shouldn't be

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding ...
2
votes
1answer
28 views

Allowing Google to index images on s3

We host our sites' static content on S3. We also have a very open robots.txt; User-agent: * Allow: * This is because in Webmaster tools I get thousands of warnings Sitemap contains urls which are ...
1
vote
1answer
40 views

Ask Google to refresh URLs in sitemap

I submitted an updated sitemap via Google Webmaster and I want Google to rescan URLs in it, as some of them are not yet found in Custom Search. I found an instruction for for CSE ...
0
votes
0answers
6 views

How to Create a sitemap in MEAN stack? [duplicate]

Well I am creating a Application in MEAN stack but I don't know how to crate a sitemap for MEAN stack
1
vote
1answer
29 views

How important is it to include <lastmod> in a sitemap?

In a sitemap, is it important to include information about when the url was last changed in a <lastmod> tag? How does not including a <lastmod> tag in a sitemap affect how my site is ...
7
votes
3answers
953 views

How soon Google is supposed to include new pages to search

I'm using Google CSE on my site. As soon as new entity is published, it's immediately added to sitemap.xml rendering script too. How soon after Googlebot fetches new sitemap new entities should be ...
3
votes
1answer
73 views

Sitemap.xml on separate server (can't use robots.txt)

We have several domains managed by the same code base. They share content and assets between each other but are separate entities online. I have started generating sitemaps for these sites and ...
1
vote
0answers
27 views

Is sitemap in sitemap_index getting indexed by Google webmaster?

it sounds a silly question, but I actually could not find a reference to it. I have created a sitemap_index with about 100-ish sitemaps. No errors. I submitted only the sitemap_index to Google ...
2
votes
0answers
27 views

Which is faster for sitemap submission: ping or submit via search console?

Previously I asked a question about marking sitemap warnings as fixed here: Resetting sitemap warnings in Webmaster Tools I look in my account today and find such warnings and errors are always ...
2
votes
2answers
38 views

Sitemap compressed is in unsupported format but valid if uncompressed

I've build a sitemap_index pointing to different sitemaps "sitemap1.xml" If they are uncompressed, they are successfully validated and accepted (Google Webmaster). However, when compressed, they are ...
1
vote
0answers
25 views

Ping Sitemap or Individual URL

On self hosted wordpress blogs when you update a post it automatically pings services such as pingomatic etc. This sends the URL of the updated post and not the xml sitemap. What's more beneficial? I ...
3
votes
1answer
101 views

Submitting a URL to Google using PHP/cUrl

I've been successfully submitting xml sitemaps to Google using cURL. The URL is http://www.google.com/webmasters/sitemaps/ping?sitemap= The problem is that XML sitemaps take several days to be ...
3
votes
1answer
32 views

Internal links to pages vs. sitemap.xml links to pages

I have a page that is not linked to from anywhere, but it is listed in sitemap.xml. It will be crawled and display in the SERP. Would it be preferable, from a SEO perspective, to have the page ...
0
votes
0answers
15 views

Google sitemaps: Url is not allowed at this location

Hi I have made a sitemap for my website. I went to google search console and added my sitemap.xml when I click test it displays the details and says that all 8 URL's are not allowed? what have I done ...
1
vote
0answers
59 views

Google can't crawl my rewritten URLs

I tried to submit my robots.txt and sitemap.xml for hours now - changing directories and .htacces rules like a horse. For some stupid reason Google can't crawl my pages and gives me warnings, that my ...
2
votes
0answers
27 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - ...
3
votes
1answer
150 views

Can HTML sitemaps be listed in robots.txt just like XML sitemaps?

I will have two sitemaps for my website. The first sitemap is the .xml version for the search engines. The second sitemap is a sitemap.php on my website for the users. I know I can list the ...
2
votes
1answer
50 views

Forcing google to rescan sitemaps instantly

When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error). I created a script that allows my co-administrator to add and remove pictures from the site and ...
0
votes
2answers
43 views

How can I compare sitemaps between two sites (staging and production)

I have rebuilt a site for a client but want to limit the SEO fallout upon deployment of their new website. How can I compare sitemaps from both sites in an effort to make sure that the sites are ...
1
vote
3answers
38 views

Does the sitemap necessarily need to be in the root folder?

I have created a sitemap index and all the additional sitemaps that I want to upload into webmasters tools. Do I need to keep them in the root folder or can I just create a folder called "sitemaps" ...
2
votes
1answer
46 views

Redirected site to www and submitted www URLs but Search Console only shows 5 pages indexed

Recently I submitted the www version of my site to Google Search Console and 301 redirected all URLs from non-www to www. I submitted the URLs in my sitemap.xml. The problem is that I've submitted 62 ...
3
votes
1answer
76 views

If I rename a sitemap, does it affect my SEO?

I would like to rename my sitemap: Would it affect my SEO at all? Would I have to resubmit it on GWT? If I have a sitemap-index.xml file, that remains the same, but I change the name of one of the ...
2
votes
1answer
49 views

Does Google prefer HTML sitemaps or XML sitemaps? And does it hurt to implement both?

I just read that Google prefers HTML sitemaps. We have so far, only implemented an XML sitemap. Would it hurt to add an HTML sitemap, and not remove the XML sitemap? Also, can you submit the HTML ...
1
vote
2answers
43 views

Why do some websites hide their sitemaps and exclude mentioning it from the robots.txt file? Does this affect SEO at all?

A lot of websites hide their sitemap.xml file. What I mean by this is that they make the URL something that a person cannot guess and then do not mention them in the robots.txt file. So my question ...
0
votes
1answer
29 views

Should I be using both “rel=canonical” and “rel=”alternate" within my sitemap?

I followed this setup in my sitemap that Google outlines on this page: https://support.google.com/webmasters/answer/189077?hl=en . <url> <loc>http://example.com/en</loc> ...
1
vote
1answer
92 views

Submitting sitemap to Google Search Console: “General HTTP error: Domain name not found”

I'm having a lot of trouble getting google search console to work with my wordpress website. I'm hosting the website myself on VPS. Everytime i try to insert xml sitemap i get General HTTP error: ...
1
vote
1answer
30 views

Is it OK that I submitted sitemaps for www and no-www?

I have submitted two sitemaps of the same website. One for www and one for no the www version of my website. Should I delete one of the 2 sitemaps on the URL with redirect? In that case I would leave ...
1
vote
1answer
37 views

The Yandex index robot is redirected when requesting this site so the robots.txt file will not be used. What's the fix?

We have a website: www.example.com which redirects to https://www.example.com. Therefore when you type www.example.com/robots.txt you are redirected to https://www.example.com/robots.txt. Another ...
2
votes
0answers
47 views

Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything. Here is my AVS tube robots.txt: User-agent: * Allow: / Disallow: ...
4
votes
1answer
52 views

Moving folder's content to a new domain, what SEO steps to take?

So, we have a functionality on example.com/folder that we decided to make as separate site and we're in need of moving it to a new domain (brand it)... This is what I'm going to make SEO wise ...
4
votes
2answers
53 views

Possible to check which links in a sitemap are indexed and which ones aren't?

Is it possible to check which links of the sitemap I've submitted are being indexed, and which ones are not? I've submitted my sitemap.xml without errors. When I check the sitemap in google search ...
2
votes
1answer
18 views

Lower priority for specific pages

I have some documents that are not as important and I would like to have a lower priority for them. If I generate a sitemap I can set the priority for these pages to a lower value, e.g. 0.1. ...
1
vote
1answer
37 views

Robots.txt disallow all except one directory and access to sitemap

robots.txt containts following instructions: User-agent: * Allow: /public/ Disallow: / Sitemap: http://sitedomain.com/sitemapindex.xml it seems that in this case sitemapindex won't be accessible ...
1
vote
1answer
51 views

Having trouble with Google indexing after extending SSL cert across whole site and resubmitting sitemap

I recently extended out SSL certification to every page on my website in an effort to gain some rank. I created and claimed the new https properties (both www and non www) in Google Search Console and ...
0
votes
2answers
40 views

Sitemap XML title in search results

I have a website that uses an XML sitemap and a robots.txt file. If I do a Google search of: site: mywebsite.co.uk "sitemap" I see the usual Google response, similar to the following image, ...
0
votes
0answers
10 views

How to Submit Website to Baidu [duplicate]

I'm looking for a guide to submit my website to Baidu, I found a tutorial in the related posts from this site, but it isn't updated and they require a mobile phone, which I don't have.
0
votes
1answer
141 views

Create a site map for my asp.net mvc web site that can be crawled by the search engines

I have created a web site using asp.net mvc-5 . and I have hosted it to one of the hosting provider and I register the web site with Google app. Now after 1.5 months of publishing the web site online ...
1
vote
1answer
29 views

What Gzip compression level can safely be used for sitemap files?

I can use PHP's gzencode function to set the compression level of data to compress and I want to compress my sitemap files then submit them to google. Currently my compression level is set to 2 ...
0
votes
1answer
66 views

SEO strategy for dynamic images ( PHP + GD )

I have several images which are generated by using PHP + GD. They consist of a background image, and colored lines drawn on top of the images. As the possible combinations depend on the behaviour of ...
2
votes
2answers
48 views

Should we include images in sitemap to index?

The sitemap of my website is currently indexing only posts and pages. It is not indexing the media content that is images and attachments. Is it a good idea not to submit images for indexing. If not ...
1
vote
1answer
25 views

Google Webmaster Tools 'index status' and 'sitemaps' are not consistent

In Google Webmaster Tools, Google Index -> Index Status shows 40 indexed pages: However Crawl > Sitemaps shows 5 indexed pages, and 35 submitted: There are no crawl errors in the sitemap. Why ...
0
votes
1answer
33 views

XML Sitemap upload for Wordpress site

I had previously used an XML Sitemap auto generator on the AIOSEO plugin but wanted to make some changes to the prioritization of some of the URLs that I could not change through the functions of the ...
1
vote
1answer
52 views

What are the different types of XML sitemaps that can be submitted to search engines?

I recently came to know about Image sitemaps. Can someone list ALL possible types of sitemaps currently used for listing entire website to search engines?
0
votes
1answer
18 views

Omit bad content in sitemap

My site basically consists out of user generated content (UGC). A user can submit a tutorial. Other users can vote on tutorials. Ratings can be negative too, SE style more or less. Now I want to ...
2
votes
1answer
36 views

How to index the right page?

My website is crawled and indexed by Google. However, one of my problem is that the indexed pages are sometimes not the right one. For example, let's say that I have star wars video on my website, ...
1
vote
2answers
59 views

Google Structured Data and sitemap resubmit?

I've submitted sitemap in google search console a few weeks ago and slowly being indexed. I just implemented Google Structure Data to all the pages. How strong does it for the data to show up in ...