All Latest 644 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #245 on Kenhub.com by Niels Hapke Jun 11, 2019 Desktop Signup X.X% Signups

Niels Tested Pattern #19: Benefit Testimonials On Kenhub.com

Pattern #19: Benefit Testimonials - Variant A

Pattern #19: Benefit Testimonials - Variant B

In this experiment a more elaborate and authentic testimonial was used instead of three more generic ones from social media sites.

Total Sample: 130,872 • Statistical Power at 5% MDE: 99.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #244 on Mt.com by Vito Mediavilla Jun 06, 2019 Desktop Product X.X% Leads

Vito Tested Pattern #49: Above The Fold Call To Action On Mt.com

Pattern #49: Above The Fold Call To Action - Variant A

Pattern #49: Above The Fold Call To Action - Variant B

A product landing page with an image was tested against one without - raising the call to action above the fold.

Total Sample: 3,711 • Statistical Power at 5% MDE: 11.2%

Test #243 on Goodui.org by Jakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

Pattern #77: Filled Or Ghost Buttons - Variant A

Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Total Sample: 25,046 • Statistical Power at 5% MDE: 22.6%

Test #242 by Alex James May 27, 2019 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #7: Social Counts

Total Sample: 79,012 • Statistical Power at 5% MDE: 56.8%

Test #241 on Kenhub.com by Niels Hapke May 24, 2019 Desktop Mobile Signup X.X% Signups

Niels Tested Pattern #105: Lead Magnets On Kenhub.com

In this experiment, a free study guide ebook was promoted on a registration page.

Total Sample: 63,631 • Statistical Power at 5% MDE: 87.5%

Test #240 on Thomasnet.com by Julian Gaviria May 16, 2019 Desktop Listing X.X% Engagement

Julian Tested Pattern #13: Centered Forms & Buttons On Thomasnet.com

Pattern #13: Centered Forms & Buttons - Variant A

Pattern #13: Centered Forms & Buttons - Variant B

In this experiment, two different positions of the View Catalog button were compared. In version A the button was smaller and on the right. In version B the button was wider and more central. (The actual test was inverted before publishing to match the A-B of the pattern.)

Total Sample: 207,844 • Statistical Power at 5% MDE: 31.5%

Test #239 on Volders.de by Alexander Krieger May 02, 2019 Desktop Home & Landing X.X% Progression

Alexander Tested Pattern #13: Centered Forms & Buttons On Volders.de

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).

Total Sample: 1,288 • Statistical Power at 5% MDE: 7.2%

Test #238 on Suzuki.be by Karl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

Pattern #104: Carousel Vs Static Grid Images - Variant A

Pattern #104: Carousel Vs Static Grid Images - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #237 on Goodui.org by Jakub Linowski Apr 29, 2019 Desktop Mobile Listing X.X% Sales

Jakub Tested Pattern #103: Money Back Guarantee On Goodui.org

Pattern #103: Money Back Guarantee - Variant A

Pattern #103: Money Back Guarantee - Variant B

Total Sample: 21,096 • Statistical Power at 5% MDE: 6%

Test #236 by Alex James Apr 04, 2019 Desktop Signup X.X% Signups

Alex Tested Pattern #9: Multiple Steps

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Total Sample: 282,316 • Statistical Power at 5% MDE: 92%

Test #235 on Thomasnet.com by Julian Gaviria Apr 02, 2019 Desktop Mobile Home & Landing X.X% Leads

Julian Tested Pattern #102: Expanded Or Condensed Layout On Thomasnet.com

Pattern #102: Expanded Or Condensed Layout - Variant A

Pattern #102: Expanded Or Condensed Layout - Variant B

In this experiment, the layout was condensed from a taller to a shorter one.

Total Sample: 11,567 • Statistical Power at 5% MDE: 17.3%

Test #234 by Alex James Apr 01, 2019 Desktop Listing X.X% Leads

Alex Tested Pattern #101: Search Keyword Highlighting

Pattern #101: Search Keyword Highlighting - Variant A

Pattern #101: Search Keyword Highlighting - Variant B

In this experiment, a different style for keyword highlighting was used.

Total Sample: 738,295 • Statistical Power at 5% MDE: 99.9%

Test #233 on Annonce.cz by Ondřej Ilinčev Apr 01, 2019 Desktop Signup X.X% Sales

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

Pattern #100: Postponed Registration - Variant A

Pattern #100: Postponed Registration - Variant B

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email.

Total Sample: 12,146 • Statistical Power at 5% MDE: 74%

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout X.X% Sales

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

Pattern #6: Customer Star Ratings - Variant A

Pattern #6: Customer Star Ratings - Variant B

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Total Sample: 20,661 • Statistical Power at 5% MDE: 30.3%

Test #231 on Glass.net by Mark Freedle Mar 14, 2019 Desktop Mobile Signup X.X% Leads

Mark Tested Pattern #20: Canned Response On Glass.net

Pattern #20: Canned Response - Variant A

Pattern #20: Canned Response - Variant B

Total Sample: 1,342 • Statistical Power at 5% MDE: 6.4%

Test #230 on Goodui.org by Jakub Linowski Mar 09, 2019 Desktop Mobile Listing X.X% Engagement

Jakub Tested Pattern #56: Hover Button On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Total Sample: 30,699 • Statistical Power at 5% MDE: 98.1%

Test #229 by Jakub Linowski Mar 08, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

Total Sample: 11,214 • Statistical Power at 5% MDE: 13%

Test #228 by Jakub Linowski Mar 05, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

The variation added a progress bar to one of the checkout steps for a ticket ordering site.

Total Sample: 12,961 • Statistical Power at 5% MDE: 14.7%

Test #227 on Volders.de by Alexander Krieger Mar 04, 2019 Desktop Signup X.X% Leads

Alexander Tested Pattern #99: Progress Bar On Volders.de

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows: