Remove: Disallow: /search
From where can I remove this line? I am using Blogger and in webmaster it shows many of my pages are blocked. From the following Q&A, I know that I need to remove this text but don't know from where.
Webmasters Stack Exchange is a question and answer site for pro webmasters. It only takes a minute to sign up.Sign up to join this community
You cant change the
robots.txtfile in Blogger unless you host your own blog in your server.
As a general rule, "search" pages should be disallowed in
robots.txt. Google does not want to include pages of search results in the index. If they did so, users would be clicking from one set of search results to another. Google does not consider that good user experience. In fact, Google has been known to de-index (penalize) entire sites that allow their site search results to be indexed.
Your can change/add custom robots.txt on Blogger. Go to Dashboard > Settings › Search preferences > Custom robots.txt >, click edit to enable and edit.
Disallow: /search only. Fill robots.txt format below to text-area (change
http://yourdomain.com to your homepage URL):
User-agent: Mediapartners-Google Disallow: User-agent: * Allow: / Sitemap: http://yourdomain.com/feeds/posts/default?orderby=UPDATED
INFO: if you remove
Disallow: /search from your robots.txt your website will experience possible problems with duplicate meta titles and descriptions which can be bad for SEO.
The robots.txt file is always found in the root folder of your site.
You can usually edit it using a file-manager which cPanel nearly always has. If your site does not have cPanel, there is probably something similar but I cannot guess without knowing more.
The nearly universal way is via FTP. You connect to your server, download the file. Edit it and then upload it back. If you use an IDE such as DreamWeaver for your web-development that is what it usually does. You can use any FTP package though, including command-line ones bundled with most operating systems.
There are two things to note: