All Latest 650 A/B Tests

In this experiment a juice cleanse product (developed by Dr. Ulrike Fischer) was supported with statements and visuals to reinforce her as a doctor and an authority figure. The control only referenced the product itself. Google translations include:

A) Headline: "Reset your body with a juice cleanse"

B) Headline: "The juice cleanse with a scientific basis" 

B) Listed out specific vitamins and supplements.

B) Added Subheadline: "Developed by Dr. Ulrike Fischer, who holds a doctorate in nutritional science" 

In this experiment, the variation remembered and prefilled user's size choices for the duration of the session. The control version always started with a fixed product size value (ex: XS). The variation prefilled them between products or screen refreshes. Impact on sales was measured.

In this experiment, product color swatches were replaced with real product photos. Whereas the control showed the colors as more abstract circles. Impact on sales was measured.

The GrowthRock team ran an experiment on one of their client's product detail pages. Instead of using a scrollbar (for mulitple images), clickable product photo thumbnails were used instead. Impact on sales was measured.

In this experiment, standard $ signs and cents were formatted into a smaller superscript. Impact on add-to-cart and sales was measured.

In this product detail page experiment, reassurances under the add-to-cart button were rearranged. The control contained copy about: free shipping and free returns formatted as two gray boxes, with a variety of payment methods and their corresponding logos underneath.

The variation used a more convention bulleted, line-by-line format. It also contained free shipping and returns, but also elaborated with "100 day returns", an "anti-hole guarantee", and "purchase with invoice" (perhaps more popular in Germany?). Impact on sales was measured.

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

In this experiment, the B variation showed the relative discount in price from within the most recent 12 months as a percentage point. A tooltip was also shown which explained this message on hover. 

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

In this experiment, a floating add-to-cart with two product choices (color and size) were added on a product page. This appeared only after scrolling past the existing / embedded product selection buy box.

The floating add-to-cart widget had another layer of complexity in that it allowed customers to make a size and color selection with an expandable fly out. Making a selection would also append the total price to the add-to-cart button label.

Impact on total transactions was measured.

In this experiment, a floating sticky bar was added on product pages. The sticky elements only appeared after users scrolled beyond the fixed buy box  area that is relatively high on the page (visible on the control screenshot). The sticky bar contained three elements: a button to configure up to three product choices, a flavor selection pulldown, and the add-to-cart button. 

In the variation, when users clicked on the flavor pulldown three things happened. First, they were anchored back to the top of the buy box. Second, the floating sticky disappeared. And third, the flavors pulldown automatically expanded (overlapping the original primary add-to-cart button).

The control did not have any of the sticky behaviors.

Impact to total sales was measured.

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Here is an experiment with an added "price per pair" in the context of products with multiple items (packs).A high contrast badge-like copy was appended underneath the price which translates to "only $X per item". Impact on sales was measured.

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

In this experiment, a simple Amazon badge was added on a product page. The translated (Google) language read: "Since we founded snocks, our customers have always been our focus - we are constantly trying to develop further. That's why we're extremely proud that Amazon attracted attention and that they named us Sales Partner of the Year in 2019."

In this experiment, the variation contained a simple text change that described the quality of the product. According to Google Translate the text changed from "tight men's underpants" (control) to "are so comfortable that you don't feel them when you wear them" (variation).

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.