Hot answers tagged

3

I have them disallowed in my robots.txt... but it doesn't change anything, Google still show them, also on those pages contact, services,... I use Noindex from Yoast. Still no result. So what can I do else? Or maybe I do something wrong If you specifically don't want these pages indexed then you should use the noindex robots meta tag in the head section ...


3

The best method would be to ask your hosting provider, but if you have SSH access you could do a simple ping, curl or even traceroute. If you do not have SSH access then you may be able to run this PHP script: SOURCE if (!$file) $status = -1; // Site is down else { fclose($file); $status = ($stoptime - $starttime) * 1000; $status = ...


3

RewriteRule ^lp/?$ /index.php [L] This fails to match because your actual URL is probably /lp/index.php (or whatever your DirectoryIndex is), not simply /lp/. (That is after Apache has internally mapped the URL to a filesystem path). So, try changing your RewriteRule pattern: RewriteRule ^lp/index\.php$ /index.php [L] Specifically, there is a ...


2

On WordPress install a plugin to do 301 redirects... Yoast SEO and Redirection plugin both do this. They allow you to input the old URLs, and map them individually to the new URL's. I would advised first making a spreadsheet with all your old urls indexed by google, and submitted by your old xml sitemaps.


2

Most posts about WordPress robots.txt are totally wrong. You should not block this in robots.txt I suggest to use only this robots.txt for WordPress blog: User-agent: * Disallow: /blog/?s=* If you block WordPress directories like admin and includes and content, then you're going to block CSS, JavaScript and other assets for Googlebot, and that will ...


1

From http://www.wpbeginner.com/wp-tutorials/how-to-optimize-your-wordpress-robots-txt-for-seo/ User-Agent: * Allow: /?display=wide Allow: /wp-content/uploads/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /refer/ Sitemap: http://domain.com/post-sitemap.xml Sitemap: http://domain.com/page-sitemap.xml Sitemap: ...


1

We have also faced similar issue on our website. This happened because initially you must have disallowed your home page in robots.txt. Now even if you allow, it takes sometime around a week-two to reflect in google indexes. I have tested your robots.txt and it looks fine.



Only top voted, non community-wiki answers of a minimum length are eligible