I have important URLs on my site to which I’d like to append temporary parameters. For example:
will have the parameter
input in the URL is dynamic.
example.com/tool/input are important URLs on the site, I do not want Google to crawl or index the URLs with the parameters.
So what I think I want to do is to add a
meta tag to the pages with parameters, AND add the following robots.txt directive:
User-agent: * Disallow: /*?foo
Would this be the best way to treat the URLs, or is there something I'm missing that might be better?