While seeing the Google Webmaster Tools report there are certain URL encoded parameters like %5c
and %22
coming up in URL's of site.
We tried to identify the issue and observed that due to incorrect structure in two of the links having \" (forward slash and ") were created in the site, which has now been corrected.
We have removed and corrected these, but we feel that Google is now crawling some of the pages with forward slash and %22
, which are coming up in Webmaster Tools as duplicate URL's.
Is there any way through robots.txt, through Google Webmaster Tools, or through .htaccess to let Google know not to follow links or crawl pages with a forward slash or %22
in it? The site is built upon the Joomla CMS platform.