Consider a website with a large number of pages. New pages are published regularly.
When publishing a new page the website operator wants to get the newly created paged crawled/indexed in Google as soon as possible. The website operator wants to minimize the time spent between publication and crawling/indexing.
Consider the site http://www.example.com/
with hundreds of thousands of pages.
The page page http://www.example.com/something/important-page.html
is created at say 12:00. I want to get important-page.html
crawled/indexed as soon as possible after 12:00. Ideally within seconds or minutes.
- What options are available to try to get Google to crawl/index a specific newly created page as soon as possible?