All Latest 633 A/B Tests

MOST RECENT TESTS

Test #383 on by Jakub LinowskiJakub Linowski Nov 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #123: Single Or Double Column Form Fields

- Variant A
- Variant B

In this simple [inverted] experiment, the variation organized the form fields into a single column. The control had two columns of form fields.
Total Sample: 2,143 • Statistical Power at 5% MDE: 23.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #344 on by Jakub LinowskiJakub Linowski Mar 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

- Variant A
- Variant B

Three common delivery questions were answered at the bottom of a checkout page. 
Total Sample: 18,871 • Statistical Power at 5% MDE: 50.1%

Test #340 on by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

- Variant A
- Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.
Total Sample: 2,883 • Statistical Power at 5% MDE: 97.3%

Test #320 on by Jakub LinowskiJakub Linowski Oct 20, 2020 Desktop Checkout X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action

- Variant A
- Variant B

An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.
Total Sample: 2,908 • Statistical Power at 5% MDE: 97.4%

Test #61 on by Someone Someone Jun 26, 2020 Desktop Checkout X.X% Sales

Someone Tested Pattern #9: Multiple Steps

- Variant A
- Variant B

In this experiment, a single screen checkout was turned into a series of smaller steps in variation B. This was achieved by showing fewer fields on the first step, and shifting the remaining ones into a 3 step modal popup. The experiment measured successful transactions (sales).
Total Sample: 8,886 • Statistical Power at 5% MDE: 11.1%

Test #274 on by Someone Someone Dec 16, 2019 Desktop Mobile Checkout X.X% Sales

Someone Tested Pattern #1: Remove Coupon Fields

- Variant A
- Variant B

In this experiment, a fully visible coupon field (A) was made less visible by turning it into a default collaped link (B). Clicking on the link caused the coupon field to appear.
Total Sample: 3,851 • Statistical Power at 5% MDE: 90.2%

Test #267 on Backstage.com by Stanley ZuoStanley Zuo Nov 05, 2019 Mobile Checkout X.X% Sales

Stanley Tested Pattern #99: Progress Bar On Backstage.com

- Variant A
- Variant B

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.
Total Sample: 8,552 • Statistical Power at 5% MDE: 6%

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Sales

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

- Variant A
- Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #232 on Yoast.com by Sjardo JanssenSjardo Janssen Mar 15, 2019 Desktop Mobile Checkout X.X% Sales

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

- Variant A
- Variant B

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!
Total Sample: 20,661 • Statistical Power at 5% MDE: 30.3%

Test #229 on by Jakub LinowskiJakub Linowski Mar 08, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

- Variant A
- Variant B
Total Sample: 11,214 • Statistical Power at 5% MDE: 13%

Test #228 on by Jakub LinowskiJakub Linowski Mar 05, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

- Variant A
- Variant B

The variation added a progress bar to one of the checkout steps for a ticket ordering site.
Total Sample: 12,961 • Statistical Power at 5% MDE: 14.7%

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

- Variant A
- Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #202 on Kenhub.com by Niels HapkeNiels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

- Variant A
- Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.
Total Sample: 2,884 • Statistical Power at 5% MDE: 49.4%

Test #176 on Kenhub.com by Niels HapkeNiels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

- Variant A
- Variant B

In this experiment, testimonials were added on a checkout screen.
Total Sample: 3,333 • Statistical Power at 5% MDE: 49.3%

Test #174 on Examine.com by Martin WongMartin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

- Variant A
- Variant B
Total Sample: 1,702 • Statistical Power at 5% MDE: 8.3%

Test #158 on Kenhub.com by Niels HapkeNiels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

- Variant A
- Variant B
Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #159 on Swimsuitsforall.com by Devesh KhanalDevesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

- Variant A
- Variant B
Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #151 on Mamaearth.ca by Michael BernsteinMichael Bernstein Feb 08, 2018 Desktop Checkout X.X% Sales

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

- Variant A
- Variant B
Total Sample: 1,614 • Statistical Power at 5% MDE: 7.4%

Test #145 on Normanrecords.com by Nathon RaineNathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

- Variant A
- Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.
Total Sample: 4,139 • Statistical Power at 5% MDE: 73.7%

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

- Variant A
- Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%