All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #355 by Jakub Linowski May 28, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #79: Product Highlights

Pattern #79: Product Highlights - Variant A

Pattern #79: Product Highlights - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 • Statistical Power at 15% MDE: 99%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #347 by Jakub Linowski Apr 07, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A

Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 • Statistical Power at 15% MDE: 80.1%

Test #346 by Stanley Zuo Mar 30, 2021 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #117: Company Logos

In this homepage experiment, company logos were added to the homepage. These were example clients or companies that Backstage works with and offers casting (job) listing from. Impact on the registration flow and membership checkouts was measured.

Total Sample: 221,012 • Statistical Power at 15% MDE: 99.9%

Test #345 on Getninjas.com.br by Rodolfo Lugli Mar 29, 2021 Desktop Home & Landing X.X% Leads

Rodolfo Tested Pattern #9: Multiple Steps On Getninjas.com.br

In this experiment, a single long form was broken into at least 3 steps.

Total Sample: 401,145 • Statistical Power at 15% MDE: 99.9%

Test #335 by Jakub Linowski Jan 27, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #32: Condensed List

The variation here has more condensed product tiles being shown on a homepage. Two pieces of information were removed: product descriptions and past selections. Impact on product page visits and total sales was measured.

Total Sample: 20,943 • Statistical Power at 15% MDE: 89.1%

Test #329 on Snocks.com by Samuel Hess Dec 23, 2020 Mobile Home & Landing X.X% Sales

Samuel Tested Pattern #14: Exposed Menu Options On Snocks.com

Pattern #14: Exposed Menu Options - Variant A

Pattern #14: Exposed Menu Options - Variant B

In this homepage experiment, a series of product categories were shown more visible near the top of the screen (instead of only being shown inside the hamburger menu). They linked up to corresponding listing pages with such items as: gifts, short socks, long socks, and underwear. Impact on adds-to-cart and total sales was measured.

Total Sample: 58,462 • Statistical Power at 15% MDE: 99.9%

Test #316 on Trydesignlab.com by Daniel Shapiro Sep 24, 2020 Desktop Mobile Home & Landing X.X% Signups

Daniel Tested Pattern #22: Empowering Headline On Trydesignlab.com

Pattern #22: Empowering Headline - Variant A

Pattern #22: Empowering Headline - Variant B

In this experiment, the headline was changed to focus more on the end-goal of the UX Academy program - that of landing your first UI/UX role.

Total Sample: 25,634 • Statistical Power at 15% MDE: 96.9%

Test #311 on Backstage.com by Stanley Zuo Aug 11, 2020 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #118: Category Images On Backstage.com

Pattern #118: Category Images - Variant A

Pattern #118: Category Images - Variant B

In this experiment, category links (linking to casting call search results) were replaced with tile images. In addition, 2 levels of categories were also replaced with a single text link for each tile. Finally, the font size of the link titles was also increased.

Total Sample: 120,519 • Statistical Power at 15% MDE: 90%

Test #288 on Kenhub.com by Niels Hapke Mar 05, 2020 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #117: Company Logos On Kenhub.com

In this experiment, customer logos (of universities attended by students using Kenhub) were placed on a homepage. The experiment tested for the effect on registration visits, and premium subscription starts.

Total Sample: 36,420 • Statistical Power at 15% MDE: 99.9%

Test #286 on Volders.de by Alexander Krieger Feb 28, 2020 Desktop Mobile Home & Landing X.X% Sales

Alexander Tested Pattern #9: Multiple Steps On Volders.de

In this experiment, a long contract cancellation landing page (control) was broken down into 4 steps with 1 final summary step (variation).

Total Sample: 67,999 • Statistical Power at 15% MDE: 99.9%

Test #263 on Goodui.org by Jakub Linowski Oct 04, 2019 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 • Statistical Power at 15% MDE: 95.9%

Test #246 on Thomasnet.com by Julian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 • Statistical Power at 15% MDE: 99.9%

Test #243 on Goodui.org by Jakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression