Skip to main content

Questions tagged [a-b-testing]

A way to test which version of a website performs better by showing one version to 50% of its visitors and another version to the remaining 50%.

Filter by
Sorted by
Tagged with
23 votes
5 answers
393 views

What are some good resources for doing A/B testing of a website?

I know of Google Website Optimizer and have used it some, and it's pretty good. Are there better options? Any good blogs about A/B testing?
tghw's user avatar
  • 823
11 votes
3 answers
660 views

Alternatives to Google Website Optimizer [duplicate]

Possible Duplicate: What are some good resources for doing A/B testing of a website? What (affordable) alternatives are there to Google Website Optimizer for A/B and multivariate tests? The pro'...
Yahel's user avatar
  • 1,721
8 votes
3 answers
3k views

Whats the best module or method for A/B testing with Drupal?

I'm looking into rolling our company's static websites into Drupal. I need to ensure that I won't ruin our chances for split testing our designs and layouts. I have found several modules out there, ...
dbonomo's user avatar
  • 160
6 votes
1 answer
600 views

Has anyone used Genetify for A/B testing

I'm working on a small project that will likely run on Wordpress, I always like to run some split testing to improve conversion rates for various goals. Typically if its a small site that I either don'...
Joshak's user avatar
  • 4,292
5 votes
2 answers
15k views

What does the % new session metric in GA Content Experiment refer to?

My understanding of the GA entity hierarchy model is the the profile entity is the parent of the experiment entity. If you go to the content experiment dashboard, click the site usage tab in the ...
BradHanks's user avatar
  • 324
4 votes
1 answer
408 views

If you run a split test, how long do you let it run before you conclude it is inconclusive?

When running A/B tests with Google Website Optimizer, Google tells you when a variation has "won". However, sometimes, the test runs for a long time and still there is no winner. When should one ...
Philippe's user avatar
  • 207
4 votes
1 answer
107 views

Are 307 Temporary Redirects safe for temporary new web site tests?

Our current site is getting close to being replaced. I was looking to do a test of our new sales funnel on the new site and compare the traffic and conversion ratios for a few days. So I was planning ...
Scott Bonner's user avatar
3 votes
5 answers
191 views

Is A/B testing worth the added expense and time?

A client is inquiring about blind A/B split testing for an online application focused mostly on usability of the design and application workflow. Someone in the client's office read an article about ...
bpeterson76's user avatar
  • 1,282
3 votes
2 answers
190 views

Has anybody split tested one password field versus password & confirm on registrations?

I'm just curious to see if this is something really worth testing, as it will require some coding to achieve.
chrism2671's user avatar
3 votes
2 answers
590 views

Should I disallow robots on A/B test pages?

I'm going to be setting up an A/B test using Google's WebsiteOptimizer on my homepage, and I plan to name my two test variants index_a.php and index_b.php. Should I be putting in rules to my robots....
neezer's user avatar
  • 151
3 votes
3 answers
190 views

A/B testing a site redesign without Google penalties

I am redesigning our job board website to be responsive. Rather than just replace the existing site with the responsive site, I want to A/B test the new responsive site alongside the existing site so ...
Gareth Elms's user avatar
3 votes
1 answer
48 views

What metrics would be useful to A/B test site search

We are trying to implement new type of instant search to our e-commerce. Our present search has lots of filters like price, category, review etc. What kind of metrics would you use to analyse if it ...
bonekost's user avatar
3 votes
1 answer
230 views

A/B Testing a site-wide feature with Google Analytics

I am considering a major adjustment to the search-input feature on a website. This search feature appears on many pages. I do have e-commerce operating in Google Analytics. I have glanced at ...
Brian Webster's user avatar
3 votes
1 answer
171 views

Google Experiments - can you run across the entire site?

Is it possible to run a Google Experiment A/B test across an entire website, rather than just a single page and a variation?
user avatar
3 votes
3 answers
428 views

Will multivariate (A/B) testing applied with 302 redirects to a subdomain affect my Google ranking?

I want to do an A B test of an entire site for a new design and UX with only slight changes in content (a big brand site that has good Google rankings for many generic keywords. My idea of ...
Lior's user avatar
  • 31
3 votes
2 answers
397 views

Long pages or accordion for content?

I'm looking at how best to display content for my website. I plan to have a large number of pages of products, which will contain a large amount of information (ideally, the amount of information on ...
James's user avatar
  • 209
2 votes
1 answer
258 views

Is it possible to A/B test javascript-generated element variation using GA Experiments and GA Events?

I'm trying to do A/B testing using Google Experiments on a javascript-generated variation elements. In simpler example, I'm trying to create a button using javascript that has different colors The ...
Petra Barus's user avatar
2 votes
3 answers
2k views

Is doing A/B tests using site redirection a bad practice?

I'm developing hotels websites here in Brazil. When the site is done, we do an A/B test with the old version to measure conversion and show to the hotel owner how good our site is. Due to the fact ...
Felipe Arenales's user avatar
2 votes
1 answer
390 views

How to conduct A/B split testing with AdSense?

Ok so I have decided to A/B test my AdSense ads. I have run a few tests, but I don't know what conclusion to draw and how to keep track of things. Some specific questions: If I have 2 test units, 1 ...
None's user avatar
  • 121
2 votes
1 answer
351 views

Is it possible to do A/B testing with Adsense ad positions?

I was just looking at Google Website Optimizer, however you need a 'conversion' page in order to measure results. If trying to optimize ad positions, this doesn't appear to be possible. Even without ...
DisgruntledGoat's user avatar
2 votes
2 answers
312 views

How can I test different types of buttons with Google Analytics Tests?

A few years ago I did A/B testing with Google where I put javascript into my page and it displayed two or more versions of a code snippets. So I had ONE url with e.g. different buttons (green and red ...
Jurik's user avatar
  • 878
2 votes
2 answers
194 views

Weird Results A/B Test in Google Website Optimizer

I set up a test in Google Website Optimizer that has a 3 variations - original (A), B, and C. In order to further validate the results of the test, I added a variation C that is exactly the same as ...
Yisroel's user avatar
  • 175
2 votes
1 answer
159 views

When should I distribute traffic evenly across all variants of an experiment?

Actually we test our trust symbols in our shop with an GA experiment. (all trust symbols vs. no trust symbols) Our last test run 16 days and declared a winner while it had only 0.26 % better ...
Jurik's user avatar
  • 878
2 votes
1 answer
291 views

Google Analytics Experiment -- How to test shopping cart

We have: GET landing.html (then select a production) POST cart1.php (then select options) POST cart2.php (then enter billing info) POST cart3.php (will process payment and then ...
William Entriken's user avatar
2 votes
0 answers
89 views

Can calling mixpanel.track cause reattribution of conversions in Mixpanel funnels?

I am currently using MixPanel to A/B test which of two different landing page images converts better. At the beginning of each hit to the page, I do mixpanel.track('Main', {illustration_ab : '{{...
Bemmu's user avatar
  • 123
1 vote
3 answers
669 views

Is it possible to A/B test web servers using a PHP redirect and sub domains without breaking all the SEO goodness?

We're trying to figure out if a certain type of web server architecture is better than our current web server. We need to A/B test these 2 boxes with live traffic to really get a sense of which one ...
jnthnclrk's user avatar
1 vote
1 answer
145 views

Alternative to Google Analytics with A/B testing and PDF scheduling

Is there a hosted solution that competes with Google Analytics and has some of the heavy hitting features: A/B testing with regression analysis Conversion tracking Funnels Schedulable reports that ...
William Entriken's user avatar
1 vote
1 answer
121 views

Sitewide A/B or Sanity Test

We are switching to a new Wordpress template and need some help. We will monitor if the test version improves the sites performance (CTR, Revenue) Technically we will: Split A Records by 50% for ...
Menashe Avramov's user avatar
1 vote
3 answers
2k views

Use Google Analytics to A/B testing with the same URL

I want to know if it's possible to perform an A/B test on different versions of the same URL using Google Analytics. So far, I have performed A/B tests on different URLs like xxx1.html and xxx2.html ...
avm_69's user avatar
  • 13
1 vote
1 answer
2k views

What is a confidence threshold of 95,0% in Google Analytics Experiments?

In Google Analytics Experiments you can Set a confidence threshold 95.0% (or 99,0% or 99,5%). The documentation says: Set a confidence threshold: The minimum confidence threshold that must be ...
Jurik's user avatar
  • 878
1 vote
1 answer
124 views

How to make a split test that reduces scripts from Google Tag Manager in a tool like VisualWebOptimizer

We have a website, where we use Google Tag Manager, in order to insert a big amount of scripts. We want to run a split test, where we reduce these scripts by 70%, which should improve load time (even ...
Lars Holdgaard's user avatar
1 vote
2 answers
99 views

Is it possible to A/B test SEO using Google Experiments?

I've read that A/B testing does not have a negative impact on SEO, but is it possible to A/B test to improve SEO? My thought is to track each visitor's referring domain and create an event when any ...
YPCrumble's user avatar
  • 197
1 vote
1 answer
42 views

Simple A/B testing tracking question for GA

I'm wanting to do simple A/B testing for my website and curious how I can leverage the basic features of google analtyics to do this. I found a very close question that already asks what I want, but ...
jamil's user avatar
  • 113
1 vote
1 answer
262 views

Does SEO ranking gets affected if I run a split URL test on our product detail page (PDP) using Visual Web Optimizer (VWO)

We are trying to run a vwo test for our pdp page.I created a test in VWO where URL www.example.com/products/productid will get redirected to www.example.com/productid?isVWOVersion=true for 50% users. ...
user1633800's user avatar
1 vote
1 answer
607 views

Event based triggers in AB testing using VWO

Is it possible to create an AB test where 100% of users see a page and only those that click a button are entered into the variation in VWO (Visual Website Optimizer)? I have asked the company but ...
GrapeSoda's user avatar
  • 1,187
1 vote
1 answer
686 views

Cookie-based A/B testing on same URL - SEO impact?

we'll run a domain-wide A/B test comparing our old design with our new responsive design. Though the content itself remains almost unchanged, the code structure and especially the design differ much. ...
Thomas's user avatar
  • 11
1 vote
1 answer
789 views

How to check Google Analytics Testing behind .htaccess wall?

I am implementing Google Analytics Test and I need to check if it works before we deploy it to live. But our staging server is behind a .htaccess security. So the Google check from Analytics does not ...
Jurik's user avatar
  • 878
1 vote
1 answer
31 views

Website testing for some percent of visitors

What's the name of website testing method when the new feature is shown only for some users (not for all), for instance 20%? Are there some online services for that? I know about A/B testing but I'm ...
Alexey Kosov's user avatar
1 vote
1 answer
2k views

Google Analytics for cookie-based A/B testing (same URL for A and B)

I have a website with share-friendly URLs like example.com/register I implemented A/B testing as a cookie because I don't want ugly unsharable URLs like example.com/registerA and example.com/...
Nicolas Raoul's user avatar
1 vote
1 answer
70 views

Google Analytics Content Experiments for non-simultaneous tests

I really like how Google Analytics displays the results of content experiments. However, it seems the tool only works for simultaneous tests. I'd like to use the tool without implementing the page ...
mnort9's user avatar
  • 141
1 vote
4 answers
4k views

How to A/B test two different site designs

I'm familar with A/B testing variations of a page via Google Website Optimiser but I'd like to A/B test completely different designs on a site wide basis or a collection of pages. So each visitor ...
user avatar
1 vote
0 answers
29 views

A/B testing in Optimize/Analytics with landing page variants and a Mailchimp Embed Signup Form

I have a landing page I'm A/B testing in Google Optimize, trying to see which variant of the landing page yields the most email signups. The problem is, I can count how many signups through the site I ...
DanSmith's user avatar
1 vote
0 answers
251 views

Google Optimize Experiment sessions not divided equall

During my two recent Google Optimize 'Redirect' experiments that I have run, traffic has not been divided equally over the variants within my experiment. I have set the weight of each page equally (...
JesseK's user avatar
  • 11
1 vote
0 answers
23 views

How can I track in Google Analytics a long list of all the A/B tests a user is assigned?

For our site's A/B testing requirement we need to track all the tests a visitor is experiencing. This is set to grow to around 100 potentially running concurrently in the future. We would like to ...
Bisquite's user avatar
1 vote
0 answers
20 views

Will switching to server side experiments improve performance and eliminate the bias introduced by client side experiments?

We have a server site rendering React application and currently are using client site A/B testing tool. The issue here is following: User comes to the site Server loads default version Client detects ...
Fabian Lurz's user avatar
1 vote
0 answers
41 views

Google Optimize A/B testing freezes the homepage

I'm trying to run 4 A/B tests using Google Optimize, on the same domain. The test should exclude themselves via the targeting, however, in most cases when I access the homepage (see: test 1a, 1b below)...
lesssugar's user avatar
  • 233
1 vote
1 answer
63 views

Google analytics reports a higher number of conversions than the a/b test (Google optimize) does for the same period

I'm running an A/B test on a website that uses a goal completion as the primary objective (Sign up form). However, I've noticed that in the goals overview tab the number of conversions is higher than ...
Shannon D'souza's user avatar
1 vote
0 answers
59 views

Tracking alternatives within goal funnels

I honestly have no idea how to phrase this better. I need to take a regular goal funnel tracking and make it report on a few alternatives within one of the steps. Here's an example: back button ...
ᴍᴇʜᴏᴠ's user avatar
1 vote
0 answers
31 views

Why is GA Experiment crushing my whole report?

Until yesterday, we had a clean reporting of our content urls that looked like: /men/shirts/shirt-with-extended-lines?color=12988 But then we activated an experiment and since then we just see this ...
Jurik's user avatar
  • 878
1 vote
0 answers
107 views

How are Google Analytic experiments impacted by filters?

Google Content Experiments allow you to create experiments for A/B testing two pages, which then slowly converge on the "better" page depending how the goals are met. However how is this convergence ...
Barry Pollard's user avatar