All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #189 on Yummly.com by Kimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Total Sample: 259,933 • Statistical Power at 15% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #186 by Devesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

Pattern #14: Exposed Menu Options - Variant A

Pattern #14: Exposed Menu Options - Variant B

In this experiment, additional product categories were added at the top of the navigation.

Total Sample: 76,974 • Statistical Power at 15% MDE: 99.9%

Test #182 on Yummly.com by Marcos Ciarrocchi Jun 12, 2018 Desktop Listing X.X% Engagement

Marcos Tested Pattern #6: Customer Star Ratings On Yummly.com

Pattern #6: Customer Star Ratings - Variant A

Pattern #6: Customer Star Ratings - Variant B

Total Sample: 673,296 • Statistical Power at 15% MDE: 99.9%

Test #181 on Yummly.com by Kimberly Cheung Jun 04, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Total Sample: 175,247 • Statistical Power at 15% MDE: 99.9%

Test #179 on Yummly.com by Marcos Ciarrocchi May 18, 2018 Desktop Listing X.X% Signups

Marcos Tested Pattern #13: Centered Forms & Buttons On Yummly.com

Pattern #13: Centered Forms & Buttons - Variant A

Pattern #13: Centered Forms & Buttons - Variant B

Total Sample: 391,537 • Statistical Power at 15% MDE: 99.9%

Test #176 on Kenhub.com by Niels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

In this experiment, testimonials were added on a checkout screen.

Total Sample: 3,333 • Statistical Power at 15% MDE: 99.9%

Test #159 on Swimsuitsforall.com by Devesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Total Sample: 66,919 • Statistical Power at 15% MDE: 99.9%

Test #158 on Kenhub.com by Niels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Total Sample: 3,516 • Statistical Power at 15% MDE: 99.9%

Test #154 on Reverb.com by Nicholas Evans Feb 20, 2018 Desktop Mobile Product X.X% Signups

Nicholas Tested Pattern #59: Inverted Or Consistent Button Styles On Reverb.com

Pattern #59: Inverted Or Consistent Button Styles - Variant A

Pattern #59: Inverted Or Consistent Button Styles - Variant B

Total Sample: 725,114 • Statistical Power at 15% MDE: 89.5%

Test #152 on Reverb.com by Nicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Pattern #15: Bulleted Reassurances - Variant A

Pattern #15: Bulleted Reassurances - Variant B

Total Sample: 487,851 • Statistical Power at 15% MDE: 98.6%

Test #149 on Reverb.com by Nicholas Evans Feb 07, 2018 Desktop Product X.X% Signups

Nicholas Tested Pattern #16: Welcome Mat - Partial On Reverb.com

Pattern #16: Welcome Mat - Partial - Variant A

Pattern #16: Welcome Mat - Partial - Variant B

Total Sample: 726,088 • Statistical Power at 15% MDE: 84.2%

Test #150 on Normanrecords.com by Nathon Raine Feb 07, 2018 Desktop Home & Landing X.X% Sales

Nathon Tested Pattern #45: Benefit Bar On Normanrecords.com

Total Sample: 120,700 • Statistical Power at 15% MDE: 99.6%

Test #148 on Kenhub.com by Niels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

Pattern #53: Problem-Solution Headline - Variant A

Pattern #53: Problem-Solution Headline - Variant B

Total Sample: 49,448 • Statistical Power at 15% MDE: 99.9%

Test #147 on Reverb.com by Nicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Pattern #20: Canned Response - Variant A

Pattern #20: Canned Response - Variant B

Total Sample: 40,229 • Statistical Power at 15% MDE: 99.9%

Test #145 on Normanrecords.com by Nathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

Pattern #1: Remove Coupon Fields - Variant A

Pattern #1: Remove Coupon Fields - Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.

Total Sample: 4,139 • Statistical Power at 15% MDE: 99.9%

Test #143 on Vivareal.com.br by Rodrigo Maués Jan 14, 2018 Desktop Listing X.X% Leads

Rodrigo Tested Pattern #56: Hover Button On Vivareal.com.br

Total Sample: 2,594,182 • Statistical Power at 15% MDE: 99.9%

Test #140 on Akademiafotografii.p... by Grzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product X.X% Leads

Grzegorz Tested Pattern #46: Pay Later On Akademiafotografii.p...

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".

Total Sample: 37,727 • Statistical Power at 15% MDE: 90.6%

Test #131 on Kenhub.com by Niels Hapke Dec 11, 2017 Desktop Home & Landing X.X% Signups