Access GoodUI through our MCP serverNEW Learn more Access GoodUI through our MCP serverNEW

All Latest 650 A/B Tests

New 10 tests added since your last visit

MOST RECENT TESTS

Test #508 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 15, 2023 Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Online.metro-cc.ru

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, the variation transformed an add-to-cart button into a shopping cart one (making it a two step process). The control had an interaction where an add-to-cart button would become a quantity selection and then a shopping cart action (a three step process). In a way, the control kept users in a "dead-end" quantity selection middle state that required clicking the back button to continue the sale. Whereas the variation automatically moved users into the next step (closer towards being able to make a purchase). Impact on sales was measured. 

Total Sample: 514,834 • Statistical Power at 10% MDE: 80.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #507 on Fairment.de by Jona EisenbergerJona Eisenberger Dec 11, 2023 Mobile Listing X.X% Sales

Jona Tested Pattern #133: Product Availability On Fairment.de

Pattern #133: Product Availability - Variant A
Pattern #133: Product Availability - Variant B

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.

Total Sample: 42,001 • Statistical Power at 10% MDE: 92.3%

Test #506 by Jakub LinowskiJakub Linowski Dec 07, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #4: Testimonials

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

Total Sample: 83,713 • Statistical Power at 10% MDE: 96.2%

Test #501 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 02, 2023 Desktop Mobile Pricing X.X% Sales

Daria Tested Pattern #132: One Time Payment Copy On Volders.de

Pattern #132: One Time Payment Copy - Variant A
Pattern #132: One Time Payment Copy - Variant B

In this experiment, the wording "one-time payment" was appended below all three pricing plans for a contract cancelation service. Impact on orders placed was measured. (Translated from German: "Einmalige Zahlung").

Total Sample: 89,887 • Statistical Power at 10% MDE: 99.9%

Test #499 on Shmoodyapp.com by Michael McSweeneyMichael McSweeney Oct 20, 2023 Mobile Signup X.X% Sales

Michael Tested Pattern #99: Progress Bar On Shmoodyapp.com

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a progress bar was added to a signup flow of a mental health app. It appeared on numerous steps of a onboarding flow. Impact on signup completions and checkouts was measured.

Total Sample: 56,735 • Statistical Power at 10% MDE: 89.8%

Test #497 on Jared.com by Craig KistlerCraig Kistler Oct 16, 2023 Mobile Product X.X% Sales

Craig Tested Pattern #7: Social Counts On Jared.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

Total Sample: 451,850 • Statistical Power at 10% MDE: 94.8%

Test #496 on Livefresh.de by Pascal DietzPascal Dietz Oct 03, 2023 Desktop Mobile Product X.X% Sales

Pascal Tested Pattern #43: Long Titles On Livefresh.de

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this product detail page experiment a simple subheadline was appended to a new product. The tagline read "Lose weight sustainably and healthily." (Google translated from German "Nachhaltig und gesund Gewicht verlieren."). Impact on sales and revenue was measured.

Total Sample: 68,822 • Statistical Power at 10% MDE: 97.6%

Test #494 on Online.Metro-cc.ru by Andrey AndreevAndrey Andreev Sep 20, 2023 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #26: Cart Reminder And Recently Viewed On Online.Metro-cc.ru

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, recently purchased products were appended at the top of the homepage. The test ran for loggedin users only. Impact on add-to-cart, sales and revenue was measured.

Total Sample: 53,513 • Statistical Power at 10% MDE: 99.9%

Test #490 by Jakub LinowskiJakub Linowski Aug 17, 2023 Desktop Mobile X.X% Sales

Jakub Tested Pattern #9: Multiple Steps

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a section dedicated to choosing gift messages was taken out and separated into its own individial step. The change happened on the first step of a checkout flow and increased the flow by an additional step. Impact on checkouts and total sales was measured.

Total Sample: 3,955 • Statistical Power at 10% MDE: 99.6%

Test #489 by Jakub LinowskiJakub Linowski Aug 14, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #78: Tags, Badges And Structured Information

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

Total Sample: 173,808 • Statistical Power at 10% MDE: 99.9%

Test #486 on Livefresh.de by Pascal DietzPascal Dietz Aug 03, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #78: Tags, Badges And Structured Information On Livefresh.de

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

Total Sample: 416,423 • Statistical Power at 10% MDE: 99.9%

Test #485 on Livefresh.de by Pascal DietzPascal Dietz Jul 27, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #131: Authority On Livefresh.de

Pattern #131: Authority - Variant A
Pattern #131: Authority - Variant B

In this experiment a juice cleanse product (developed by Dr. Ulrike Fischer) was supported with statements and visuals to reinforce her as a doctor and an authority figure. The control only referenced the product itself. Google translations include:

A) Headline: "Reset your body with a juice cleanse"

B) Headline: "The juice cleanse with a scientific basis" 

B) Listed out specific vitamins and supplements.

B) Added Subheadline: "Developed by Dr. Ulrike Fischer, who holds a doctorate in nutritional science" 

Total Sample: 138,248 • Statistical Power at 10% MDE: 99.9%

Test #484 on Snocks.com by Melina HessMelina Hess Jul 21, 2023 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #80: Persistent Filters On Snocks.com

Pattern #80: Persistent Filters - Variant A
Pattern #80: Persistent Filters - Variant B

In this experiment, the variation remembered and prefilled user's size choices for the duration of the session. The control version always started with a fixed product size value (ex: XS). The variation prefilled them between products or screen refreshes. Impact on sales was measured.

Total Sample: 920,166 • Statistical Power at 10% MDE: 99.9%

Test #483 on Menufy.com by Aleksandr ElesevAleksandr Elesev Jul 17, 2023 Desktop Checkout X.X% Sales

Aleksandr Tested Pattern #124: Confirmed Selection On Menufy.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, a thanking confirmation message was appended at the top of the checkout screen of a local food delivery service. Impact on completed transactions was measured.

Total Sample: 8,626 • Statistical Power at 10% MDE: 99.9%

Test #482 by Jakub LinowskiJakub Linowski Jul 13, 2023 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #124: Confirmed Selection

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, the choice of adding a product to cart was confirmed with a further positive message in the header of the next step (on the add to cart page). Once users left the product detail page, instead of simply stating the product name, the title was rephrased as "Product [X] Makes a Great Gift. They'll Love It!". I view this as a higher "intensity" experiment, given that the add-to-cart page was in some way already confirming the choice. Impact on sales was measured.

Total Sample: 3,379 • Statistical Power at 10% MDE: 95.5%

Test #479 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. Benefit items not included in the lower plans were also shown with grayed out styles (and an "x"). Clearly the higher paid plan had all the benefits listed. Impact on transactions was measured. 

Total Sample: 104,863 • Statistical Power at 10% MDE: 99.9%

Test #480 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. The lowest plan only had one benefit, whereas the highest plan had 3. Impact on transactions was measured. 

Total Sample: 104,902 • Statistical Power at 10% MDE: 99.9%

Test #477 on Snocks.com by Melina HessMelina Hess Jun 09, 2023 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #95: Clickable Product Previews On Snocks.com

Pattern #95: Clickable Product Previews - Variant A
Pattern #95: Clickable Product Previews - Variant B

In this experiment, product color swatches were replaced with real product photos. Whereas the control showed the colors as more abstract circles. Impact on sales was measured.

Total Sample: 916,207 • Statistical Power at 10% MDE: 99.9%

Test #476 by Devesh KhanalDevesh Khanal Jun 08, 2023 Mobile Product X.X% Sales

Devesh Tested Pattern #95: Clickable Product Previews

Pattern #95: Clickable Product Previews - Variant A
Pattern #95: Clickable Product Previews - Variant B

The GrowthRock team ran an experiment on one of their client's product detail pages. Instead of using a scrollbar (for mulitple images), clickable product photo thumbnails were used instead. Impact on sales was measured.

Total Sample: 848,081 • Statistical Power at 10% MDE: 99.9%

Test #473 by Jakub LinowskiJakub Linowski May 26, 2023 Desktop Home & Landing X.X% Sales

Jakub Tested Pattern #19: Benefit Testimonials

Pattern #19: Benefit Testimonials - Variant A
Pattern #19: Benefit Testimonials - Variant B

In this experiment, very short form testimonials (with a reference to over 3 million customers) were replaced with 3 more elaborate ones. These elaborate or benefit testimonials contained: highlighted statements, star reviews, emphasized location, tag summaries and photos of the purchased product. The control also contained a 3 testimonial carousel interaction.

This test appeared at the bottom of a longer homepage with additional product listings above.

Total Sample: 66,794 • Statistical Power at 10% MDE: 99.9%