All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto Nov 12, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

Pattern #34: Open In A New Tab - Variant A

Pattern #34: Open In A New Tab - Variant B

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Total Sample: 778,955 • Statistical Power at 10% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #49 on Menufy.com by Aleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

Total Sample: 21,184 • Statistical Power at 10% MDE: 99.9%

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

Pattern #40: Blurred Product Background - Variant A

Pattern #40: Blurred Product Background - Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Total Sample: 138,106 • Statistical Power at 10% MDE: 99.9%

Test #202 on Kenhub.com by Niels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

Pattern #13: Centered Forms & Buttons - Variant A

Pattern #13: Centered Forms & Buttons - Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.

Total Sample: 2,884 • Statistical Power at 10% MDE: 97.7%

Test #201 by Ben Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Total Sample: 59,003 • Statistical Power at 10% MDE: 96.5%

Test #197 on Reverb.com by Nicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

In the variation, customer reviews were exposed from a less visible tab view.

Total Sample: 223,110 • Statistical Power at 10% MDE: 99.9%

Test #196 on Vivareal.com.br by Vinicius Barros Peixoto Aug 14, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #80: Persistent Filters On Vivareal.com.br

Pattern #80: Persistent Filters - Variant A

Pattern #80: Persistent Filters - Variant B

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Total Sample: 441,738 • Statistical Power at 10% MDE: 99.9%

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Pattern #78: Tags, Badges And Structured Information - Variant A

Pattern #78: Tags, Badges And Structured Information - Variant B

Total Sample: 371,274 • Statistical Power at 10% MDE: 99.9%

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Total Sample: 1,335,347 • Statistical Power at 10% MDE: 99.9%

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Total Sample: 95,776 • Statistical Power at 10% MDE: 96.5%

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales