4

When running A/B tests with Google Website Optimizer, Google tells you when a variation has "won". However, sometimes, the test runs for a long time and still there is no winner.

When should one decide that there is no significant difference between two variations and stop the test?

8

The Visual Website Optimizer blog has an A/B test duration calculator designed to answer your question. It's published as an Excel spreadsheet, but don't let that put you off.

Enter your original conversion rate, the difference you're hoping to detect, the number of variations you're testing, and your average daily traffic, and it spits out the number of days you should wait before stopping the test.

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.