Consider a website with a large number of pages. New pages are published regularly.
When publishing a new page the website operator wants to get the newly created paged crawled/indexed in Google as soon as possible. The website operator wants to minimize the time spent between publication and crawling/indexing.
Consider the site
http://www.example.com/ with hundreds of thousands of pages.
The page page
http://www.example.com/something/important-page.html is created at say 12:00. I want to get
important-page.html crawled/indexed as soon as possible after 12:00. Ideally within seconds or minutes.
- What options are available to try to get Google to crawl/index a specific newly created page as soon as possible?