Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard.
Is there a way to bulk submit URLs to it?
-
1Not what you're asking but you should consider submitting XML sitemaps. – kqw Sep 18 '14 at 23:16
-
I do already, but thanks for the suggestion. – Newmania Sep 18 '14 at 23:24
Indirectly, yes:
Create a page with links to all the URLs you'd like re-crawled (like a sitemap) and add that to your website.*
Submit the URL to that page to Fetch as Google, selecting Desktop as the fetching strategy, as detailed here: Use Fetch as Google.
Once Fetch as Google is complete, and within 4 hours time, from the Fetches Table next to the status of the fetch, select Submit to Index, then select Crawl this URL and its direct links, followed by Submit.
As indicated in Ask Google to re-crawl your URLs, the above will:
Submit the URL as well as all the other pages that URL links to for re-crawling. You can submit up to 10 of requests of this kind per month.
*As commented by John Mueller, you can also submit a sitemap file or a text file containing a list of URLs.
-
1@dan That is far superior to my idea! I will keep this in my rolodex of tricks. – closetnoc Sep 19 '14 at 1:06
-
1You could also just create a sitemap file (or text URL-list file) and submit that. – John Mueller Sep 24 '14 at 7:03
-
-
@JohnMueller Thanks. I'm now trying to speed up de-indexation of pages; could I submit a sitemap of pages to de-index (I'm not sure if it's counter intuitive to point a re-crawl to pages to re-index?). – Newmania Jun 13 '16 at 10:59
-
1
Submitting a sitemap (XML,.txt, HTML or RSS) allows bots to discover pages. If you need even faster submission, do it manually or some types of automation (using selenium).
-
Nice. I didn't know you could use
.txtfor sitemaps. I thought they had to be according to the sitemap protocol only. – Geremia Mar 17 '18 at 17:07
