Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

If I am blocking a page called pay.php, google won't crawl this page. But what about the links that are on this page as default as menu and footer links? Will these links also be blocked from crawling?

But I see that only one page is getting restricted by google bot other than pay.php page, and not other links. Why would this be?

share|improve this question

migrated from stackoverflow.com Oct 1 '11 at 5:04

This question came from our site for professional and enthusiast programmers.

add comment

2 Answers 2

Answer lies in your line If I am blocking a page called pay.php, google won't crawl this page. If search engines doesn't even crawl that page it won't then find any links etc on that particular page.

share|improve this answer
add comment

If the links are linked to only from the page you blocked, they will not be crawled. Of course, these links are probably linked to and crawled from other pages.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.