Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [sitemap]

A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

2
votes
1answer
70 views

“video markup” vs “video sitemap”

I already implemented a video sitemap, based on Google's recommendation. Now, I am reading about video markups. The only information, I got on the relationship of both approaches to each other, is: ...
1
vote
1answer
110 views

Does including images in a sitemap.xml as unique pages have any negative affect on SEO?

So I know that the correct way of identifying pages in a sitemap is like this: <url> <loc>http://www.example.com/</loc> </url> If I want to include images in the sitemap, ...
1
vote
1answer
339 views

How to create a sitemap for a forum

How would you create a sitemap for a forum where pages are created every hour, because on daily basis approximately 5-10 new pages are created. Should you be adding all of them to the sitemap and ...
2
votes
0answers
19 views

How can I tell which URLs in my sitemap Google Search Console is complaining about?

I've seen many people complaining about this error, but they all seem to know what the URL is. For example, one reporter said that Google was complaining about URLs which weren't in their sitemap at ...
2
votes
0answers
221 views

What is the recommended way to make inline SVG images indexable?

On pages that have many SVG images, it would be desirable to inline all the svg images since this will reduce the number of HTTP requests and significantly reduce the size of all SVGs combined because ...
2
votes
0answers
37 views

How to create sitemaps with only non-www URLs in MediaWiki website?

I usually prefer the non-www URL for my website (http://example.com, not http://www.example.com). While submitting the site to Google one needs to set a preferred domain by choosing either the www or ...
2
votes
0answers
209 views

Google Search Console reports the number of indexed pages in the sitemap fluctuates

We have a large site. The number of indexed pages in our sitemap has been decreasing and increasing constantly in the last month. What should I do? Is there a special reason?
2
votes
0answers
149 views

Sitemap time stamps = negative SEO impact?

Recently experienced a 50% drop in traffic and one of the only things I changed is the sitemaps.xml We have 9 sitemaps with 50k URL each, I added the following formatting <URL>http://url.com&...
2
votes
0answers
149 views

Google search console reports URLs blocked by robots.txt even though they shouldn't be

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding ...
2
votes
0answers
235 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - http://example.com/sitemap....
2
votes
0answers
97 views

Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything. Here is my AVS tube robots.txt: User-agent: * Allow: / Disallow: /...
2
votes
0answers
109 views

What to do with my RSS sitemap & PubSubHubbub for fast URL indexation in Google?

I've read on several places, that by using Google PubSubHubbub will get the newest pages posted in RSS feeds ultra fast indexed by Google. So, I have my RSS sitemap with lots of new pages added daily ...
1
vote
0answers
14 views

How to deal with great number of URLs that will not be in anchor and should be known only for friendly crawlers?

I have a hypothetical page, that contains pages like: example.com/see/cat example.com/see/mouse example.com/see/<basically anything> I can have thousands of such pages. The number of pages ...
1
vote
0answers
42 views

Should I serve a customized sitemap to Baidu that only contains URLs with Chinese content?

I'm working on a multilingual website which has Chinese as one of the supported languages. I have a sitemap that includes links to all the pages on the website. Should I serve to the Baidu bot a ...
1
vote
0answers
212 views

How can I upload a sitemap to my Google Sites site with a custom URL?

I created a site for an e-portfolio using the new Google Sites. Google sites automatically generates a sitemap for you at sites.google.com/yoursite/system/feeds/sitemap, which can then be submitted ...
1
vote
0answers
47 views

Prevent Indexing of Images from my website but hosted on S3 / Cloudinary

I understand that as a website/domain owner (eg: example.com), we can prevent images from our website from being indexed by Google (GoogleBot / GoogleBot-Image). We could add a meta tag to the whole ...
1
vote
0answers
40 views

Should .webp images get included in my image sitemap XML when the same images are also available in more widely supported image formats?

I have an image sitemap xml. This points to my .jpg, .png etc images. However, Google has a new format .webp. Since not all browsers support this format yet I have to keep both the .webp image as well ...
1
vote
0answers
110 views

After HTTPS migration can we leave the old sitemap as it is and upload the new sitemap with HTTPS URLs?

We are migrating from HTTP to HTTPS. We left our old sitemap as it is and uploaded the new sitemap with HTTPS pages with new name. I read it at Google’s Search Console Help: Move a site with URL ...
1
vote
0answers
252 views

Can the sitemap contain URLs only differentiated by a # (hash)?

My website is a single page and uses the anchor tags to navigate. When I generated my sitemap using an online tool, it generated 2 URLs: <url> <loc>https://www.example.com/</loc> ...
1
vote
0answers
288 views

How do I submit a sitemap for URLs on a redirected domain?

I have domain www.example.ca and the domain is redirected to www.example.com. I have sitemap in www.example.com. How do I submit sitemap hosted in www.example.com for www.example.ca?
1
vote
0answers
368 views

Is it okay to ping Google multiple times in a day when my sitemap is updated?

I have a site where Sitemaps are dynamically generated cos I use an awesome framework. The framework also has a ping google method. I'm thinking of pinging Google every time some-one posts something ...
1
vote
0answers
171 views

Submitting various sitemaps for different languages

i have a site translated into 4 languages. I have submitted the sitemap to google webmaster tools (GWT) as one sitemap and translation links like below: I got a recommendation to create different ...
1
vote
0answers
49 views

Bing indexed pages decreased from 2400 to 2 in 5 days

Bing indexed pages decreasing rapidly.. Previously bing indexed pages was 2400 in search. Then I submitted sitemaps. After 4-5 days of submitting site maps .. Bing index starts decreasing from ...
1
vote
0answers
201 views

Can I have two sitemaps on one WordPress site

I have a WordPress site geared towards our Chinese audience in China and around the world. I'm using the Yoast SEO plugin for general SEO, but I’ve been trying to do some things that are helpful for ...
1
vote
0answers
569 views

Google can't crawl my rewritten URLs

I tried to submit my robots.txt and sitemap.xml for hours now - changing directories and .htacces rules like a horse. For some stupid reason Google can't crawl my pages and gives me warnings, that my ...
1
vote
0answers
41 views

Mobile Sitemap - Error 404 - WMT dont index it?

I have a site that is not responsive. It has 3 versions : PC, tablet and mobile, every version has different pages . I have made 2 sitemaps: one for the PC version and one for the mobile version. ...
1
vote
0answers
297 views

URLs not allowed error for one property, but not for the other?

All of our XML sitemaps are located on another domain than the domain they're referring to, for instance: - Sitemaps would be located at sitemap-domain.com/sitemap-1.xml - URLs being referenced in ...
1
vote
0answers
148 views

Discrepancy in Recent warning to Fix mobile usability issues

Our website has a desktop version and a separate mobile version (/mobile) which is determined in the .htaccess file when mobile users access the site they are taken specifically to the mobile site. ...
0
votes
0answers
16 views

Master Sitemap holding child sitemaps on different domain

I have a master sitemap, index.xml on https://www.example.com/index.xml This XML contain childmaps pointing to a subdomain URL of mine like below: <?xml version="1.0" encoding="UTF-8"?> <...
0
votes
0answers
19 views

GSC Sitemap Coverage questions

I recently noticed that my sitemap listed the urls in my site beginning with http:// although the canonical tags of the page are https://, so I resubmitted my sitemap with the correct urls. I am not ...
0
votes
0answers
15 views

Page Rank: Is it okay for /general-content/ to also have all the content that is on /general-content/specific-content/?

I'm building some pages with before-and-after photo galleries on them, and I'm trying to figure out the best site structure that would yield the highest ranked pages. There is a page called /before-...
0
votes
0answers
44 views

Resubmitted sitemap after 404 error correction. Is delay normal for re-crawl?

I submitted a sitemap of about 500 urls. Due to an unexpected server downtime, the pages had returned 404 errors during crawl. (The errors were reported in search console.) Now the server is up again ...
0
votes
0answers
285 views

HTTP 403 error (Forbidden) URLs not accessible

I have a domain that has "fallen off a cliff" for searches in Google. Searches that used to be in position 1-4 are now gone from page 1. In reviewing Google Webmaster Tools, I am seeing two problems: ...
0
votes
0answers
30 views

hreflang in sitemap for dynamically generated sites

What would be the best way to place my hreflang tags in my sitemap if I can serve the same URL in two different languages? We happen to have a translation service that does all that stuff for us ...
0
votes
0answers
99 views

Google Webmaster tools URLs blocked by empty Sitemap

I am trying to update a Sitemap to show support for multiple languages via hreflang tags. After adding the new Sitemap Google Webmaster Tools continues to display the Sitemap warning even after ...
0
votes
0answers
412 views

Sitemap error “Network unreachable” but accessible in URL?

I'm using XML sitemap generated by OpenCart 2.0 which is in URL index.php?route=feed/google_sitemap. When I submit in Google Search Console, it shows error as below: Type: Errors Issue: Error ...
0
votes
0answers
280 views

Is It Acceptable To Regularly Ping Google With Sitemap Regardless of Change?

I have a complex site that has a variety of content that changes irregularly. Due to the complexity of the site, knowing when the site has changed (and therefore when a sitemap needs to be regenerated)...
0
votes
0answers
30 views

Should Google news and Google sitemap index contains all posts in the site?

I have a big database of 5M post, and I have sitemap index like this but without lastmod, and because of this large number of posts it will be hard if I make and sitemap index contains 100000 sitemap ...