All Latest 650 A/B Tests

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

This experiment started right after users of a trading app received trade order expiry notification (for a security trading app). In the control, after clicking the notifications, users would have to navigate to the trade themselves. In the variation, 1) an additional step was added which informed what happened (an order was not place and expired) and 2) they were automatically send to the order page. Impact on orders placed was measured.

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

In this experiment, the control shows an (X) close option within a signup flow, whereas the variation had it removed. Clicking the close icon would collapse the signup modal and show the product page. Users were still able use the back and forward functionality.

(The test was inversed in order to fit the pattern). Impact on signups was measured.

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

In this experiment, additional customer product photos were shown at the top of the product page. A "Show More Photos" button was also added which launched a modal with additional and larger images. Impact on sales was measured.

In this experiment, three popular juice products were shown higher on the variation (instead of lower in the control). Impact on sales was measured.

In this experiment, reaffirming copy was added for particular size options in the variation. Here is the translation from German:

"These boxer shorts will be kept. Did you know that our boxer shorts in S are rarely returned? They fit perfectly - see for yourself!"

Impact on sales was measured.

In this experiment, "persistence" of 4 product choices was added in the variation. When users made a product selection such as: duration, payment terms, starting month or shipping frequency, their choices were remembered and defaulted on next visits, reloads or when viewing other products. Impact on adds to cart and sales was measured.

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)