Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in the xml sitemap or not?

Edit:

If i wanted my page to be indexed (google follows the links in it), but not show up in search results, should i remove robots.txt and use the robots meta tag with "noindex" ?

share|improve this question
    
How does the page 404Error.aspx ever get indexed? You shouldn't be redirecting to that page if there is a 404 error... –  DisgruntledGoat Nov 7 '11 at 14:12
    
404Error is a page i use to replace the default 404 error. I want it to be crawled as it contains links back to the homepage but i don't want it indexed for obvious reasons. –  TheGateKeeper Nov 7 '11 at 18:37
add comment

2 Answers

up vote 1 down vote accepted

If i wanted my page to be indexed (google follows the links in it), but not show up in search results, should i remove robots.txt and use the robots meta tag with "noindex" ?

Yes.

share|improve this answer
add comment

If you want to stop Google and the other Search Engines to have in their index this page, I see no reason to have the link in the sitemap too. You should have the link only in your robots.txt

share|improve this answer
    
Thats what i tought but i wanted to be sure, thanks friend –  TheGateKeeper Nov 7 '11 at 13:25
    
@TheGateKeeper Glad to help you ;) –  Aurelio De Rosa Nov 7 '11 at 13:27
    
I edited the question, please have a look –  TheGateKeeper Nov 7 '11 at 13:34
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.