Access GoodUI through our MCP serverNEW Learn more Access GoodUI through our MCP serverNEW

All Latest 650 A/B Tests

New 10 tests added since your last visit

MOST RECENT TESTS

Test #461 on Snocks.com by Melina HessMelina Hess Mar 23, 2023 Mobile Product X.X% Sales

Melina Tested Pattern #15: Bulleted Reassurances On Snocks.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this product detail page experiment, reassurances under the add-to-cart button were rearranged. The control contained copy about: free shipping and free returns formatted as two gray boxes, with a variety of payment methods and their corresponding logos underneath.

The variation used a more convention bulleted, line-by-line format. It also contained free shipping and returns, but also elaborated with "100 day returns", an "anti-hole guarantee", and "purchase with invoice" (perhaps more popular in Germany?). Impact on sales was measured.

Total Sample: 522,417 • Statistical Power at 15% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #449 on Snocks.com by Melina HessMelina Hess Dec 31, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #78: Tags, Badges And Structured Information On Snocks.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

Total Sample: 508,908 • Statistical Power at 15% MDE: 99.9%

Test #448 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 30, 2022 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #21: What It's Worth On Zapimoveis.com.br

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experiment, the B variation showed the relative discount in price from within the most recent 12 months as a percentage point. A tooltip was also shown which explained this message on hover. 

Total Sample: 136,584 • Statistical Power at 15% MDE: 99.9%

Test #446 by Jakub LinowskiJakub Linowski Dec 15, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #18: Single Or Alternative Buttons

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Total Sample: 100,016 • Statistical Power at 15% MDE: 99.9%

Test #444 by Melina HessMelina Hess Nov 30, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating add-to-cart with two product choices (color and size) were added on a product page. This appeared only after scrolling past the existing / embedded product selection buy box.

The floating add-to-cart widget had another layer of complexity in that it allowed customers to make a size and color selection with an expandable fly out. Making a selection would also append the total price to the add-to-cart button label.

Impact on total transactions was measured.

Total Sample: 1,483,721 • Statistical Power at 15% MDE: 99.9%

Test #441 by Melina HessMelina Hess Nov 23, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating sticky bar was added on product pages. The sticky elements only appeared after users scrolled beyond the fixed buy box  area that is relatively high on the page (visible on the control screenshot). The sticky bar contained three elements: a button to configure up to three product choices, a flavor selection pulldown, and the add-to-cart button. 

In the variation, when users clicked on the flavor pulldown three things happened. First, they were anchored back to the top of the buy box. Second, the floating sticky disappeared. And third, the flavors pulldown automatically expanded (overlapping the original primary add-to-cart button).

The control did not have any of the sticky behaviors.

Impact to total sales was measured.

Total Sample: 67,618 • Statistical Power at 15% MDE: 99.9%

Test #430 by Jakub LinowskiJakub Linowski Sep 20, 2022 Desktop Product X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, up to 5 recently viewed product pages would appear on the left hand navigation. The idea was to make it easier for users get back to what they were looking at in case they were browsing. These recently viewed products were not visibile in the control. Impact on adds-to-cart and completed transactions was measured.

Total Sample: 10,324 • Statistical Power at 15% MDE: 98.2%

Test #429 on Snocks.com by Melina HessMelina Hess Aug 16, 2022 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #121: Free Shipping On Snocks.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Total Sample: 56,067 • Statistical Power at 15% MDE: 99.9%

Test #421 on Amazon.com by Marika FranciscoMarika Francisco Jul 15, 2022 Desktop Mobile Product X.X% Sales

Marika Tested Pattern #43: Long Titles On Amazon.com

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Total Sample: 3,727,581 • Statistical Power at 15% MDE: 99.9%

Test #411 by Ayat ShukairyAyat Shukairy May 09, 2022 Desktop Mobile Product X.X% Sales

Ayat Tested Pattern #126: Bottom Or Left Thumbnails

Pattern #126: Bottom Or Left Thumbnails - Variant A
Pattern #126: Bottom Or Left Thumbnails - Variant B

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Total Sample: 588,443 • Statistical Power at 15% MDE: 99.9%

Test #408 by Jakub LinowskiJakub Linowski Apr 29, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #67: Currency & Taxes

Pattern #67: Currency & Taxes - Variant A
Pattern #67: Currency & Taxes - Variant B

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Total Sample: 16,332 • Statistical Power at 15% MDE: 86.4%

Test #407 on Snocks.com by Melina HessMelina Hess Apr 22, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #125: Unit Prices On Snocks.com

Pattern #125: Unit Prices - Variant A
Pattern #125: Unit Prices - Variant B

Here is an experiment with an added "price per pair" in the context of products with multiple items (packs).A high contrast badge-like copy was appended underneath the price which translates to "only $X per item". Impact on sales was measured.

Total Sample: 112,178 • Statistical Power at 15% MDE: 99.9%

Test #402 on Snocks.com by Melina HessMelina Hess Mar 25, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #103: Money Back Guarantee On Snocks.com

Pattern #103: Money Back Guarantee - Variant A
Pattern #103: Money Back Guarantee - Variant B

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Total Sample: 456,229 • Statistical Power at 15% MDE: 99.9%

Test #395 by Jakub LinowskiJakub Linowski Jan 31, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #52: How It Works

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Total Sample: 17,099 • Statistical Power at 15% MDE: 80.2%

Test #392 by Jakub LinowskiJakub Linowski Dec 31, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #122: Zigzag Layout

Pattern #122: Zigzag Layout - Variant A
Pattern #122: Zigzag Layout - Variant B

In this experiment, paragraph style copy was reorganized into a zig zag layout with key sections being reinforiced with copy-as-image statements. Impact on adds-to-cart and sales was measured.

Total Sample: 41,827 • Statistical Power at 15% MDE: 98.3%

Test #385 on Snocks.com by Samuel HessSamuel Hess Nov 25, 2021 Mobile Product X.X% Sales

Samuel Tested Pattern #63: Trust Seals On Snocks.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B

In this experiment, a simple Amazon badge was added on a product page. The translated (Google) language read: "Since we founded snocks, our customers have always been our focus - we are constantly trying to develop further. That's why we're extremely proud that Amazon attracted attention and that they named us Sales Partner of the Year in 2019."

Total Sample: 351,255 • Statistical Power at 15% MDE: 99.9%

Test #382 on Snocks.com by Samuel HessSamuel Hess Oct 31, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this experiment, the variation contained a simple text change that described the quality of the product. According to Google Translate the text changed from "tight men's underpants" (control) to "are so comfortable that you don't feel them when you wear them" (variation).

Total Sample: 140,756 • Statistical Power at 15% MDE: 99.9%

Test #376 on Snocks.com by Samuel HessSamuel Hess Sep 29, 2021 Mobile Desktop Product X.X% Sales

Samuel Tested Pattern #15: Bulleted Reassurances On Snocks.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

Total Sample: 136,126 • Statistical Power at 15% MDE: 99.9%

Test #366 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.

Total Sample: 80,881 • Statistical Power at 15% MDE: 99.9%

Test #365 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 13, 2021 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Mvideo.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, reviews on product pages were exposed completely. Instead of hiding them under a clickable tab, they were shown by default in the variation. Impact on sales was measured.

Total Sample: 78,120 • Statistical Power at 15% MDE: 81%