All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #250 on Volders.de by Alexander Krieger Jul 25, 2019 Desktop Mobile Signup X.X% Signups

Alexander Tested Pattern #106: Back Buttons On Volders.de

In this experiment, a version without a back button was tested against a one where it was positioned in the upper left corner. This test occured on a second step of a contract cancellation service.

Total Sample: 16,894 • Statistical Power at 10% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #39 on Over-blog.com by Tael Pinault Jul 02, 2019 Desktop Signup X.X% Signups

Tael Tested Pattern #83: Progressive Fields On Over-blog.com

Pattern #83: Progressive Fields - Variant A

Pattern #83: Progressive Fields - Variant B

This test explored a progressive disclosure interaction in variation B. When a user started typing text into the first field, two more fields expanded into view.

Total Sample: 10,464 • Statistical Power at 10% MDE: 90.6%

Test #245 on Kenhub.com by Niels Hapke Jun 11, 2019 Desktop Signup X.X% Signups

Niels Tested Pattern #19: Benefit Testimonials On Kenhub.com

Pattern #19: Benefit Testimonials - Variant A

Pattern #19: Benefit Testimonials - Variant B

In this experiment a more elaborate and authentic testimonial was used instead of three more generic ones from social media sites.

Total Sample: 130,872 • Statistical Power at 10% MDE: 99.9%

Test #242 by Alex James May 27, 2019 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #7: Social Counts

Total Sample: 79,012 • Statistical Power at 10% MDE: 98.8%

Test #241 on Kenhub.com by Niels Hapke May 24, 2019 Desktop Mobile Signup X.X% Signups

Niels Tested Pattern #105: Lead Magnets On Kenhub.com

In this experiment, a free study guide ebook was promoted on a registration page.

Total Sample: 63,631 • Statistical Power at 10% MDE: 99.9%

Test #236 by Alex James Apr 04, 2019 Desktop Signup X.X% Signups

Alex Tested Pattern #9: Multiple Steps

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Total Sample: 282,316 • Statistical Power at 10% MDE: 99.9%

Test #233 on Annonce.cz by Ondřej Ilinčev Apr 01, 2019 Desktop Signup X.X% Sales

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

Pattern #100: Postponed Registration - Variant A

Pattern #100: Postponed Registration - Variant B

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email.

Total Sample: 12,146 • Statistical Power at 10% MDE: 99.9%

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

Pattern #40: Blurred Product Background - Variant A

Pattern #40: Blurred Product Background - Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Total Sample: 138,106 • Statistical Power at 10% MDE: 99.9%

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Total Sample: 1,335,347 • Statistical Power at 10% MDE: 99.9%

Test #189 on Yummly.com by Kimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups