2

The answer for my question might be inherent in the question itself- that if I want Google to crawl my site for a custom site search, such as through Programmable Search Engine, that it is those same means that results in my website showing up in public Google searches and if that's the case then great I can move on, but I just want to know if it's possible...

The use case is a website hosted on a subdomain which would host old articles, archived resources, that we don't want to compete with the more up-to-date content on the main domain. However we still want users to access this page via the main site and be able to search through this content. Google Programmable Search is an easy way to have this happen and it's very cost effective.

Currently this subdomain is not accessible by Google or IPs outside of our local network, but as soon as I let Google through to index the page in order to get the searching to work, then doesn't that mean it is then findable on public Google searches?

Thanks

Improve this question
3
  • As far as I know, you can rely on including/excluding URL patterns. Everything would be crawled but the excluded parts won't show in the results support.google.com/programmable-search/answer/…
    – Emirodgar
    Commented Jan 14, 2022 at 8:31
  • I suppose this may help in my efforts. I can include just the article/archive url paths and exclude everything else, but does it mean that there's a chance anyone searching on Google would still be able to find it?
    – Bobby_Cheh
    Commented Jan 14, 2022 at 16:27
  • In theory, if it is excluded from the crawler, it will never show up on Google
    – Emirodgar
    Commented Jan 14, 2022 at 22:35

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.