Tag Info

New answers tagged

3

http://www.example.com/ and http://www.example.com are the same URL. Whether or not the trailing slash is shown in the browser address bar is purely cosmetic - when the request is sent to the server the slash will be included. (http://www.example.com/foo and http://www.example.com/foo/ on the other hand are different URLs.) If the site you're working on is ...


1

If you want google to stop indexing a site, page or directory and you don't want to redirect to a new site, you have a few options. Delete all content Add <meta name="robots" content="noindex,nofollow"> flags to your content. Use webmaster tools to remove URLs from Google's index Add a server-level password to your directories you no longer want ...


1

Remove the robots.txt files and have the urls simply return 410. It tells google the resource is gone and is never coming back. No need to get complicated with robots tags.


0

robots.txt does not stop Google from indexing content. It only tells them not to crawl it. Content blocked by robots.txt can still be listed in Google's search results. To actually prevent Google from indexing content you need to use the x-robots-tag HTTP header. You can do this in code or in your .htaccess file. But any pages you want to block from ...


0

Need to still support legacy without redirects? Even if you are still supporting it and deep down it is still implemented, the 501 seems rather hand in hand to your situation. Those in the know could still use it, while randoms would see the 501 for v1. 10.5.2 501 Not Implemented The server does not support the functionality required to fulfill the ...



Top 50 recent answers are included