All Latest 633 A/B Tests

MOST RECENT TESTS

Test #606 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 22, 2025 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

Total Sample: 1,317,945 Statistical Power at 5% MDE: 79.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #605 on by Jakub LinowskiJakub Linowski Aug 21, 2025 Desktop Mobile Product X.X% Revenue

Jakub Tested Pattern #113: More Or Fewer Plans

 - Variant A
 - Variant B

A less expensive product choice (club duration) was added at the beginning of the options. Impact on adds-to-cart, sales and revenue were measured.

Test #604 on by Melina HessMelina Hess Jul 31, 2025 Mobile Product X.X% Sales

Melina Tested Pattern #46: Pay Later

 - Variant A
 - Variant B

In this experiment, a Paypal badge with "buy now pay later" copy (pay within 30 days) was added underneath the add-to-cart button on product pages. Impact on adds to cart and sales was measured.

Total Sample: 645,035 Statistical Power at 5% MDE: 99.9%

Test #603 on Kay.com by Craig KistlerCraig Kistler Jul 30, 2025 Desktop Mobile Product X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Kay.com

 - Variant A
 - Variant B

In this experiment, product pages (variant) asked users if they were interested to see holiday gifts with two buttons. Upon clicking "yes", the UI expanded to make another choice in order to see gifts for: Her, Him or Kids. Clicking any of these three would send users to dedicated listing pages with more product recommendations. Impact on sales was measured.

Total Sample: 3,080,311 Statistical Power at 5% MDE: 99.9%

Test #601 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 22, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, 4 selling points were added at the top of product details pages. Clicking on them would launch a modal with more details.

Total Sample: 481,189 Statistical Power at 5% MDE: 42.8%

Test #599 on Finn.com by Tim KarcherTim Karcher Jun 27, 2025 Mobile Product X.X% Leads

Tim Tested Pattern #10: Postponed Modal Forms On Finn.com

 - Variant A
 - Variant B

This is a heavily confounded multi-change experiment. In the variation, product choices on product detail pages were taken off and moved to a 2nd step (a new step). This also resulted in the price and primary button becoming more visible from an upward position shift. Impact on adds-to-cart and lead generation was measured.

Total Sample: 23,733 Statistical Power at 5% MDE: 9.9%

Test #598 on by Jakub LinowskiJakub Linowski Jun 27, 2025 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

This experiment started when a user started a custom product build and visited any other product page. In the variation, a resume button appeared that would bring the customers back to their custom build. Impact on checkouts and sales was measured.

Total Sample: 1,177 Statistical Power at 5% MDE: 7.7%

Test #597 on by Frazer MawsonFrazer Mawson Jun 26, 2025 Mobile Product X.X% Sales

Frazer Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, a fixed add-to-cart button along with the quantity selector was transformed into an always floating one. Impact on sales was measured. (Visitors are session based).

Total Sample: 247,046 Statistical Power at 5% MDE: 58.2%

Test #596 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 24, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #7: Social Counts On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

Total Sample: 64,535 Statistical Power at 5% MDE: 8.8%

Test #595 on by Jakub LinowskiJakub Linowski Jun 09, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

 - Variant A
 - Variant B

In this mobile product page experiment, the variation changed the look of the floating button area once a product was chosen.

The variation showed a button with 1) pricing totals along with 2) a link back to the edit area and 3) a button that allowed to add to cart directly. Whereas the control only linked back to the top of the page where the product selction was possible. Impact on adds-to-cart and sales was measured.

Total Sample: 22,957 Statistical Power at 5% MDE: 12.9%

Test #594 on Obs.no by Joachim FurusethJoachim Furuseth May 28, 2025 Mobile Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,262,310 Statistical Power at 5% MDE: 99.9%

Test #593 on Obs.no by Joachim FurusethJoachim Furuseth May 27, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 694,658 Statistical Power at 5% MDE: 83.2%

Test #591 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 925,560 Statistical Power at 5% MDE: 70.3%

Test #592 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Mobile Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,328,302 Statistical Power at 5% MDE: 96.3%

Test #589 on by Jakub LinowskiJakub Linowski Apr 30, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #68: Welcome Discount

 - Variant A
 - Variant B

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

Total Sample: 23,605 Statistical Power at 5% MDE: 17.5%

Test #587 on https://asics.com App by Andrey ProkhorovAndrey Prokhorov Apr 26, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #140: Product Descriptions

 - Variant A
 - Variant B

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

Total Sample: 164,018 Statistical Power at 5% MDE: 79.9%

Test #586 on by Jakub LinowskiJakub Linowski Apr 25, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

 - Variant A
 - Variant B

In this experiment, a video unboxing and product overview video was added on product pages (below the buy box). After pressing play, the video started playing with a visible "close" control to allow stopping of the video.

Impact on adds to cart and sales was measured.

Total Sample: 4,828 Statistical Power at 5% MDE: 6.7%

Test #581 on Asics.com by Andrey ProkhorovAndrey Prokhorov Mar 21, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #104: Carousel Vs Static Grid Images On Asics.com

 - Variant A
 - Variant B

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

Total Sample: 163,627 Statistical Power at 5% MDE: 80.4%

Test #579 on Jared.com by Craig KistlerCraig Kistler Feb 23, 2025 Mobile Product X.X% Sales

Craig Tested Pattern #21: What It's Worth On Jared.com

 - Variant A
 - Variant B

In this experiment, typical dollar values of typical coverages for an extended protection plan were shown. This ran on a product page of a jewelery site. Impact on on adds to cart, sales and uptake of the upsell was measured. Traffic split was 25/75.

Total Sample: 2,285,675 Statistical Power at 5% MDE: 21.2%

Test #578 on by Jakub LinowskiJakub Linowski Feb 20, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

 - Variant A
 - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video started playing with the controls only appearing for a short time before fading away.

Notice the confounding from pushing the buy box further down.

Impact on adds to cart and sales was measured.

Total Sample: 21,142 Statistical Power at 5% MDE: 21.6%