All Latest 644 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #91 on 3dhubs.com by Rob Draaijer Jan 01, 2017 Desktop Listing X.X% Leads

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.

Total Sample: 54,916 • Statistical Power at 5% MDE: 54.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #63 on Vanityplanet.com by Doug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

Pattern #30: Authentic Photos - Variant A

Pattern #30: Authentic Photos - Variant B

Total Sample: 6,000 • Statistical Power at 5% MDE: 7.6%

Test #64 on Goodui.org by Jakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

Pattern #41: Sticky Call To Action - Variant A

Pattern #41: Sticky Call To Action - Variant B

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.

Total Sample: 35,058 • Statistical Power at 5% MDE: 11.2%

Test #77 on Easycredit.se by Hugo Palm Dec 05, 2016 Desktop Mobile Signup X.X% Leads

Hugo Tested Pattern #5: Top Aligned Labels On Easycredit.se

Pattern #5: Top Aligned Labels - Variant A

Pattern #5: Top Aligned Labels - Variant B

Total Sample: 8,292 • Statistical Power at 5% MDE: 94.8%

Test #70 on Uptowork.com by Kuba Koziej Nov 01, 2016 Desktop Pricing X.X% Revenue

Kuba Tested Pattern #17: Least Or Most Expensive First On Uptowork.com

Pattern #17: Least Or Most Expensive First - Variant A

Pattern #17: Least Or Most Expensive First - Variant B

This test simply ordered the pricing plans from highest to most expensive. Overall sales decreased by an insignificant -1% with a possible +14% increase to the most expensive plan. The net effect was an insignificant 0.9% increase the the premium plans.

Test #66 on Telestream.net by Chris Goward Nov 01, 2016 Shopping Cart X.X% Sales

Chris Tested Pattern #9: Multiple Steps On Telestream.net

Telestream specializes in software that make it possible to get video content to any audience regardless of how it is created, distributed, or viewed. Telestream’s customer acquisition strategy is centered around driving traffic to their website to trial, or to purchase from their online store. Shoppers can buy software online, download it right away, and immediately start using it. The variation was designed with the same information as the control except spread across 4 steps (instead of 3). The rationale was that each step would be shorter and less overwhelming for the user.

Total Sample: 7,610 • Statistical Power at 5% MDE: 33.7%

Test #14 on Prizegrab.com by Greg Van Horn Oct 20, 2016 Desktop Home & Landing X.X% Leads

Greg Tested Pattern #8: Natural Language Forms On Prizegrab.com

Pattern #8: Natural Language Forms - Variant A

Pattern #8: Natural Language Forms - Variant B

Total Sample: 3,133 • Statistical Power at 5% MDE: 8.8%

Test #51 on Menufy.com by Aleksandr Elesev Oct 20, 2016 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #63: Trust Seals On Menufy.com

Total Sample: 14,269 • Statistical Power at 5% MDE: 99.9%

Test #11 on Prizegrab.com by Greg Van Horn Oct 20, 2016 Desktop Home & Landing X.X% Leads

Greg Tested Pattern #3: Fewer Form Fields On Prizegrab.com

Pattern #3: Fewer Form Fields - Variant A

Pattern #3: Fewer Form Fields - Variant B

Total Sample: 3,142 • Statistical Power at 5% MDE: 8.2%

Test #59 by Someone Oct 01, 2016 Home & Landing X.X% Leads

Someone Tested Pattern #8: Natural Language Forms

Total Sample: 3,716 • Statistical Power at 5% MDE: 7.7%

Test #48 on Adoramapix.com by Herman Klein Oct 01, 2016 Product X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Total Sample: 19,399 • Statistical Power at 5% MDE: 48.7%

Test #58 on Bingocardcreator.com by Patrick McKenzie Aug 26, 2016 Desktop Home & Landing X.X% Leads

Patrick Tested Pattern #8: Natural Language Forms On Bingocardcreator.com

Total Sample: 736 • Statistical Power at 5% MDE: 6.3%

Test #55 on Autodesk.com by Lisa Seaman Aug 11, 2016 Desktop Home & Landing X.X% Progression

Lisa Tested Pattern #14: Exposed Menu Options On Autodesk.com

Pattern #14: Exposed Menu Options - Variant A

Pattern #14: Exposed Menu Options - Variant B

In this test, some of the menu options (accessible in the top right hamburger menu) were copied over onto the top navigation. The options that were exposed were "All Products", "Free Trial" and "Buy".

Total Sample: 453,820 • Statistical Power at 5% MDE: 99.9%

Test #54 by Chris Goward Aug 11, 2016 Desktop Mobile Product X.X% Leads

Chris Tested Pattern #7: Social Counts

Client background (e.g. industry, business model):

This client is a healthcare company: their website is designed for lead generation. This company collects leads for their kidney-focused programs and ultimately provides kidney dialysis for those who decide to become patients.

Experiment background:

This experiment was focused on a right rail and the goal was to encourage more users to sign up to download the client’s free diabetes-friendly cookbook.

Total Sample: 95,073 • Statistical Power at 5% MDE: 12.4%

Test #69 on Digitalmarketer.com by Justin Rondeau Aug 01, 2016 Desktop Mobile Home & Landing X.X% Signups