Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [sitemap]

A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

2
votes
1answer
79 views

“video markup” vs “video sitemap”

I already implemented a video sitemap, based on Google's recommendation. Now, I am reading about video markups. The only information, I got on the relationship of both approaches to each other, is: ...
1
vote
1answer
31 views

Shrinking site's size by removing pages from sitemap and from internal links

We are an eCommerce site with about 50,000 pages. We decided to focus on about 2,000 so google will crawl our site better. We planning to remove 48,000 pages from the sitemaps and from the site links, ...
1
vote
1answer
118 views

Does including images in a sitemap.xml as unique pages have any negative affect on SEO?

So I know that the correct way of identifying pages in a sitemap is like this: <url> <loc>http://www.example.com/</loc> </url> If I want to include images in the sitemap, ...
1
vote
1answer
351 views

How to create a sitemap for a forum

How would you create a sitemap for a forum where pages are created every hour, because on daily basis approximately 5-10 new pages are created. Should you be adding all of them to the sitemap and ...
0
votes
1answer
31 views

Something is wrong with my XML Sitemap, how to fix

My question is related to my previous question How to remove indexed pages from google effectively where I was advised to create XML sitemap and submit it to google. The advice looked solid so I ...
3
votes
0answers
74 views

Google search console says XML sitemap “can't fetch”, yet sitemap passes test and is visible in browser

I've submitted a couple of sitemaps in search console but they are stuck on the 'cant fetch' status and have been for weeks now. If I go to the URL I can see the sitemap OK and if I go to the old ...
2
votes
0answers
24 views

How can I tell which URLs in my sitemap Google Search Console is complaining about?

I've seen many people complaining about this error, but they all seem to know what the URL is. For example, one reporter said that Google was complaining about URLs which weren't in their sitemap at ...
2
votes
0answers
282 views

What is the recommended way to make inline SVG images indexable?

On pages that have many SVG images, it would be desirable to inline all the svg images since this will reduce the number of HTTP requests and significantly reduce the size of all SVGs combined because ...
2
votes
0answers
209 views

Google Search Console reports the number of indexed pages in the sitemap fluctuates

We have a large site. The number of indexed pages in our sitemap has been decreasing and increasing constantly in the last month. What should I do? Is there a special reason?
2
votes
0answers
156 views

Sitemap time stamps = negative SEO impact?

Recently experienced a 50% drop in traffic and one of the only things I changed is the sitemaps.xml We have 9 sitemaps with 50k URL each, I added the following formatting <URL>http://url.com&...
2
votes
0answers
159 views

Google search console reports URLs blocked by robots.txt even though they shouldn't be

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding ...
2
votes
0answers
243 views

How to make nginx override web app route for sitemap and robots?

I would like to make nginx serve sitemap and robots. My problem is that route http://example.com/ is handled by flask, configured to handle request with certain patterns - http://example.com/sitemap....
2
votes
0answers
98 views

Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything. Here is my AVS tube robots.txt: User-agent: * Allow: / Disallow: /...
2
votes
0answers
110 views

What to do with my RSS sitemap & PubSubHubbub for fast URL indexation in Google?

I've read on several places, that by using Google PubSubHubbub will get the newest pages posted in RSS feeds ultra fast indexed by Google. So, I have my RSS sitemap with lots of new pages added daily ...
1
vote
0answers
35 views

When submitting a cross-domain sitemap, does robots.txt need to list individual XML file, or just the index?

I am trying to move a bunch of sitemap files out of my website into a separate site that just has static assets, however I am struggling to understand the cross-site submissions mentioned on sitemaps....
1
vote
0answers
13 views

Should mobile sitemaps point to canonical urls

I've recently developed a mobile-friendly version of an old site. The old site still does really well in the SERPs for key terms, so I don't want to redirect everyone (yet). But I do want to give ...
1
vote
0answers
17 views

How to deal with great number of URLs that will not be in anchor and should be known only for friendly crawlers?

I have a hypothetical page, that contains pages like: example.com/see/cat example.com/see/mouse example.com/see/<basically anything> I can have thousands of such pages. The number of pages ...
1
vote
0answers
44 views

Should I serve a customized sitemap to Baidu that only contains URLs with Chinese content?

I'm working on a multilingual website which has Chinese as one of the supported languages. I have a sitemap that includes links to all the pages on the website. Should I serve to the Baidu bot a ...
1
vote
0answers
439 views

How can I upload a sitemap to my Google Sites site with a custom URL?

I created a site for an e-portfolio using the new Google Sites. Google sites automatically generates a sitemap for you at sites.google.com/yoursite/system/feeds/sitemap, which can then be submitted ...
1
vote
0answers
59 views

Prevent Indexing of Images from my website but hosted on S3 / Cloudinary

I understand that as a website/domain owner (eg: example.com), we can prevent images from our website from being indexed by Google (GoogleBot / GoogleBot-Image). We could add a meta tag to the whole ...
1
vote
0answers
48 views

Should .webp images get included in my image sitemap XML when the same images are also available in more widely supported image formats?

I have an image sitemap xml. This points to my .jpg, .png etc images. However, Google has a new format .webp. Since not all browsers support this format yet I have to keep both the .webp image as well ...
1
vote
0answers
39 views

How to create sitemaps with only non-www URLs in MediaWiki website?

I usually prefer the non-www URL for my website (http://example.com, not http://www.example.com). While submitting the site to Google one needs to set a preferred domain by choosing either the www or ...
1
vote
0answers
149 views

After HTTPS migration can we leave the old sitemap as it is and upload the new sitemap with HTTPS URLs?

We are migrating from HTTP to HTTPS. We left our old sitemap as it is and uploaded the new sitemap with HTTPS pages with new name. I read it at Google’s Search Console Help: Move a site with URL ...
1
vote
0answers
414 views

Can the sitemap contain URLs only differentiated by a # (hash)?

My website is a single page and uses the anchor tags to navigate. When I generated my sitemap using an online tool, it generated 2 URLs: <url> <loc>https://www.example.com/</loc> ...
1
vote
0answers
326 views

How do I submit a sitemap for URLs on a redirected domain?

I have domain www.example.ca and the domain is redirected to www.example.com. I have sitemap in www.example.com. How do I submit sitemap hosted in www.example.com for www.example.ca?
1
vote
0answers
410 views

Is it okay to ping Google multiple times in a day when my sitemap is updated?

I have a site where Sitemaps are dynamically generated cos I use an awesome framework. The framework also has a ping google method. I'm thinking of pinging Google every time some-one posts something ...
1
vote
0answers
195 views

Submitting various sitemaps for different languages

i have a site translated into 4 languages. I have submitted the sitemap to google webmaster tools (GWT) as one sitemap and translation links like below: I got a recommendation to create different ...
1
vote
0answers
50 views

Bing indexed pages decreased from 2400 to 2 in 5 days

Bing indexed pages decreasing rapidly.. Previously bing indexed pages was 2400 in search. Then I submitted sitemaps. After 4-5 days of submitting site maps .. Bing index starts decreasing from ...
1
vote
0answers
214 views

Can I have two sitemaps on one WordPress site

I have a WordPress site geared towards our Chinese audience in China and around the world. I'm using the Yoast SEO plugin for general SEO, but I’ve been trying to do some things that are helpful for ...
1
vote
0answers
597 views

Google can't crawl my rewritten URLs

I tried to submit my robots.txt and sitemap.xml for hours now - changing directories and .htacces rules like a horse. For some stupid reason Google can't crawl my pages and gives me warnings, that my ...
1
vote
0answers
42 views

Mobile Sitemap - Error 404 - WMT dont index it?

I have a site that is not responsive. It has 3 versions : PC, tablet and mobile, every version has different pages . I have made 2 sitemaps: one for the PC version and one for the mobile version. ...
1
vote
0answers
311 views

URLs not allowed error for one property, but not for the other?

All of our XML sitemaps are located on another domain than the domain they're referring to, for instance: - Sitemaps would be located at sitemap-domain.com/sitemap-1.xml - URLs being referenced in ...
1
vote
0answers
157 views

Discrepancy in Recent warning to Fix mobile usability issues

Our website has a desktop version and a separate mobile version (/mobile) which is determined in the .htaccess file when mobile users access the site they are taken specifically to the mobile site. ...
0
votes
0answers
33 views

Sitemap confusion on Google Console: One website accessible by two URLs

I am a novice when it comes to websites, the language and technical side. Excuse if this sounds elementary. If you have one website accessible by two URLs, do I need to add a sitemap for each one? ...
0
votes
0answers
36 views

GSC Sitemap Coverage questions

I recently noticed that my sitemap listed the urls in my site beginning with http:// although the canonical tags of the page are https://, so I resubmitted my sitemap with the correct urls. I am not ...
0
votes
0answers
15 views

Page Rank: Is it okay for /general-content/ to also have all the content that is on /general-content/specific-content/?

I'm building some pages with before-and-after photo galleries on them, and I'm trying to figure out the best site structure that would yield the highest ranked pages. There is a page called /before-...
0
votes
0answers
50 views

Resubmitted sitemap after 404 error correction. Is delay normal for re-crawl?

I submitted a sitemap of about 500 urls. Due to an unexpected server downtime, the pages had returned 404 errors during crawl. (The errors were reported in search console.) Now the server is up again ...
0
votes
0answers
32 views

Should Google news and Google sitemap index contains all posts in the site?

I have a big database of 5M post, and I have sitemap index like this but without lastmod, and because of this large number of posts it will be hard if I make and sitemap index contains 100000 sitemap ...