I'm running a website base it by vbulletin. Recently I moved one of my forums to a private section of my website so users and googlebot cannot access it there.

Now I'm getting lots of access denied errors in my Google Webmaster Tools. How can I tell to googlebot to do not crawl that special forum and associated topics?

  • 1
    I'm assuming you submit sitemaps to google when you try to index your site. If you do, consider removing URLs that aren't accessible by everyone and resubmit and let google take its sweet time in reindexing your site. – Mike -- No longer here Aug 5 '17 at 17:31
  • Thanks, I did it before but I received the same (403) errors in webmaster again – AliR3ZA Aug 5 '17 at 19:56

Try adding a robots noindex directive for the private section of the site, or a robots noindex meta tag to said pages.

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.