Sign up ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I have a site with address and I have put Google analytics javascript scripts in it. I have made an app for my site, I want that everytime a user uses app, he visit the site in the application with built in browser which is inside the application ( I am using C# for application and .NET web browser ). User will address in the app and I just have put google analytics scripts in that page and nothing else.

And I want to disallow this address /appvisit in my robots.txt file . I want to know that Is there any problem with doing this? will google crawl in the /appvisit directory ? Does google hate this work? and will google think this traffic is true and normal?


share|improve this question

1 Answer 1

up vote 1 down vote accepted

There is no problem with disallowing that address in your robots.txt file. Google won't crawl it, but some crawlers ignore robots.txt. There is nothing wrong with saying that part of your site shouldn't be crawled. Measuring visitors is a different thing to letting search engines index your site.

(I did find someone who found that URLs used by analytics were then used for crawling, but as I say Google obeys robots.txt

share|improve this answer
So visiting the is exactly like visiting for google ? –  mahdavipanah Jun 22 '12 at 13:09
No. If you block then they won't crawl it, though they will count visitors using analytics. They will crawl other pages on, but won't count visitors. –  paulmorriss Jun 22 '12 at 13:22
I'm a little confused, So if 10 people visit and 2 people visit and in both two pages there is google analytics javascript scripts, So Google will say my website visitors are 12 or not ? –  mahdavipanah Jun 22 '12 at 13:25
Google will say there are 12 in that case, but you said above that analytics are in /appvisit and nowhere else. –  paulmorriss Jun 22 '12 at 13:31
thanks, I got it. –  mahdavipanah Jun 22 '12 at 13:49

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.