7

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard.

Is there a way to bulk submit URLs to it?

2
  • 1
    Not what you're asking but you should consider submitting XML sitemaps.
    – the
    Sep 18, 2014 at 23:16
  • I do already, but thanks for the suggestion.
    – Newmania
    Sep 18, 2014 at 23:24

2 Answers 2

9

Indirectly, yes:

  1. Create a page with links to all the URLs you'd like re-crawled (like a sitemap) and add that to your website.*

  2. Submit the URL to that page to Fetch as Google, selecting Desktop as the fetching strategy, as detailed here: Use Fetch as Google.

  3. Once Fetch as Google is complete, and within 4 hours time, from the Fetches Table next to the status of the fetch, select Submit to Index, then select Crawl this URL and its direct links, followed by Submit.

As indicated in Ask Google to re-crawl your URLs, the above will:

Submit the URL as well as all the other pages that URL links to for re-crawling. You can submit up to 10 of requests of this kind per month.

*As commented by John Mueller, you can also submit a sitemap file or a text file containing a list of URLs.

9
  • 1
    @dan That is far superior to my idea! I will keep this in my rolodex of tricks.
    – closetnoc
    Sep 19, 2014 at 1:06
  • 1
    You could also just create a sitemap file (or text URL-list file) and submit that. Sep 24, 2014 at 7:03
  • @JohnMueller Thanks for your input here, added that to the answer.
    – dan
    Sep 24, 2014 at 23:24
  • @JohnMueller Thanks. I'm now trying to speed up de-indexation of pages; could I submit a sitemap of pages to de-index (I'm not sure if it's counter intuitive to point a re-crawl to pages to re-index?).
    – Newmania
    Jun 13, 2016 at 10:59
  • 1
    @Newmania sure, that works too. Jun 14, 2016 at 12:17
1

Submitting a sitemap (XML,.txt, HTML or RSS) allows bots to discover pages. If you need even faster submission, do it manually or some types of automation (using selenium).

1
  • Nice. I didn't know you could use .txt for sitemaps. I thought they had to be according to the sitemap protocol only.
    – Geremia
    Mar 17, 2018 at 17:07

Not the answer you're looking for? Browse other questions tagged or ask your own question.