Access GoodUI through our MCP serverNEW Learn more Access GoodUI through our MCP serverNEW

All Latest 650 A/B Tests

New 10 tests added since your last visit

MOST RECENT TESTS

Test #453 by Jakub LinowskiJakub Linowski Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, the footer was simplified with multiple elements being removed (catalog request, secondary links, and a guarantee). Additionally, a more prominent phone number was also displayed.

Total Sample: 17,107 • Statistical Power at 15% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #454 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this shopping cart experiment, a tall footer was completely removed. The footer contained elements such as: app download links, a newsletter signup, secondary web site links, trust symbols, social media icons and company contant information. Impact on sales was measured.

Total Sample: 18,201 • Statistical Power at 15% MDE: 99.9%

Test #452 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jan 30, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #62: Urgent Next Day Delivery On Volders.de

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

In this experiment, a count down timer was added near the top of a checkout page. The timer was only shown before 1pm and clarified that the serivce (contract cancellation) will be initiated on the same day if users act before a cut off time. Impact on completed payments was measured.

Total Sample: 40,999 • Statistical Power at 15% MDE: 99.9%

Test #450 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 20, 2023 Desktop Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, top category navigation (with fly out categories) was removed from the shopping cart of an online store. Impact on sale transactions was measured.

Total Sample: 4,737 • Statistical Power at 15% MDE: 97.1%

Test #449 on Snocks.com by Melina HessMelina Hess Dec 31, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #78: Tags, Badges And Structured Information On Snocks.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

Total Sample: 508,908 • Statistical Power at 15% MDE: 99.9%

Test #448 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 30, 2022 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #21: What It's Worth On Zapimoveis.com.br

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experiment, the B variation showed the relative discount in price from within the most recent 12 months as a percentage point. A tooltip was also shown which explained this message on hover. 

Total Sample: 136,584 • Statistical Power at 15% MDE: 99.9%

Test #447 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 23, 2022 Mobile Listing X.X% Leads

Vinicius Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional call to action (Whatsapp link) was added on a listing page of one of Brazil's largest real estate sites.In the variation the 3 calls to action include: a link that launched the phone interaction, a general contact lead form, and finally the Whatsapp link (added in the variant).  Impact on total lead starts and completions was measured.

Total Sample: 1,416,128 • Statistical Power at 15% MDE: 99.9%

Test #446 by Jakub LinowskiJakub Linowski Dec 15, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #18: Single Or Alternative Buttons

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Total Sample: 100,016 • Statistical Power at 15% MDE: 99.9%

Test #444 by Melina HessMelina Hess Nov 30, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating add-to-cart with two product choices (color and size) were added on a product page. This appeared only after scrolling past the existing / embedded product selection buy box.

The floating add-to-cart widget had another layer of complexity in that it allowed customers to make a size and color selection with an expandable fly out. Making a selection would also append the total price to the add-to-cart button label.

Impact on total transactions was measured.

Total Sample: 1,483,721 • Statistical Power at 15% MDE: 99.9%

Test #442 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 27, 2022 Desktop Mobile Home & Landing X.X% Sales

Daria Tested Pattern #4: Testimonials On Volders.de

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, three testimonials were appended at the bottom of landing pages of a contract cancelation service (paid). These testimonials were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Total Sample: 73,143 • Statistical Power at 15% MDE: 99.9%

Test #443 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 27, 2022 Desktop Mobile Home & Landing X.X% Sales

Daria Tested Pattern #4: Testimonials On Volders.de

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, four TrustPilot reviews were appended at the bottom of landing pages of a contract cancelation service (paid). These reviews were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Total Sample: 72,943 • Statistical Power at 15% MDE: 99.9%

Test #441 by Melina HessMelina Hess Nov 23, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating sticky bar was added on product pages. The sticky elements only appeared after users scrolled beyond the fixed buy box  area that is relatively high on the page (visible on the control screenshot). The sticky bar contained three elements: a button to configure up to three product choices, a flavor selection pulldown, and the add-to-cart button. 

In the variation, when users clicked on the flavor pulldown three things happened. First, they were anchored back to the top of the buy box. Second, the floating sticky disappeared. And third, the flavors pulldown automatically expanded (overlapping the original primary add-to-cart button).

The control did not have any of the sticky behaviors.

Impact to total sales was measured.

Total Sample: 67,618 • Statistical Power at 15% MDE: 99.9%

Test #437 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Oct 28, 2022 Desktop Mobile Listing X.X% Leads

Rodrigo Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional and alternative text based call to action link was added on real estate properity listings. Instead of only having "Ligar" ("Call"), "Enviar mensagem" was also appended ("Send Message"). This additional link lead to a lead-gen form. 

Total Sample: 2,595,541 • Statistical Power at 15% MDE: 99.9%

Test #435 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Oct 17, 2022 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #9: Multiple Steps On Volders.de

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a question about a customer's reason for purchase was broken out into a separate step and moved earlier in the process. In the control, this question was asked in the final checkout step along with a plan selection (Step 4 of 4). In the variation, this question was shifted as a standalone first step (Step 1 of 5). Impact on completed purchases was measured (for a contract cancellation service in this case).

Total Sample: 139,608 • Statistical Power at 15% MDE: 99.9%

Test #432 on Snocks.com by Melina HessMelina Hess Sep 29, 2022 Mobile Global X.X% Sales

Melina Tested Pattern #94: Visible Search On Snocks.com

Pattern #94: Visible Search - Variant A
Pattern #94: Visible Search - Variant B

In this experiment, search functionality was added in the variation, globally on mobile. Impact on sales was measured

Total Sample: 1,175,864 • Statistical Power at 15% MDE: 99.9%

Test #431 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Sep 23, 2022 Desktop Mobile Pricing X.X% Sales

Daria Tested Pattern #21: What It's Worth On Volders.de

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experiment, a historically higher price point was added as a crossed out anchor. The control only showed the current price. The variation showed the current price with the higher price crossed out. Impact on sales was measured.

Total Sample: 34,645 • Statistical Power at 15% MDE: 99.9%

Test #430 by Jakub LinowskiJakub Linowski Sep 20, 2022 Desktop Product X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, up to 5 recently viewed product pages would appear on the left hand navigation. The idea was to make it easier for users get back to what they were looking at in case they were browsing. These recently viewed products were not visibile in the control. Impact on adds-to-cart and completed transactions was measured.

Total Sample: 10,324 • Statistical Power at 15% MDE: 98.2%

Test #429 on Snocks.com by Melina HessMelina Hess Aug 16, 2022 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #121: Free Shipping On Snocks.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Total Sample: 56,067 • Statistical Power at 15% MDE: 99.9%

Test #428 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Aug 16, 2022 Desktop Mobile Signup X.X% Sales

Daria Tested Pattern #26: Cart Reminder And Recently Viewed On Volders.de

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this test 1) a passive hint communicated to users that their data will be saved for 7 days for them to be able to continue their cancellation later and 2) dropped off users were targeted with an email campaign within the first 4 hours after drop off. The reminder email linked users to a shipping page (checkout page) without them requiring to fill out their personal, contract information one more time. 

Total Sample: 155,342 • Statistical Power at 15% MDE: 99.9%

Test #422 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jul 22, 2022 Desktop Mobile Shopping Cart X.X% Sales

Daria Tested Pattern #3: Fewer Form Fields On Volders.de

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

A birthdate field was removed during a signup process for a paid contract cancellation service. Impact on progression (next step) and sales (completed transactions) was measured.

Total Sample: 20,345 • Statistical Power at 15% MDE: 82.8%