All Latest 650 A/B Tests

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

In this experiment, three popular juice products were shown higher on the variation (instead of lower in the control). Impact on sales was measured.

In this experiment, reaffirming copy was added for particular size options in the variation. Here is the translation from German:

"These boxer shorts will be kept. Did you know that our boxer shorts in S are rarely returned? They fit perfectly - see for yourself!"

Impact on sales was measured.

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

In this experiment, a photo of a doctor (who researched and created the a cleanising juice - the product) was appended after the add to cart button. The copy is translated as follows from "Von der promovierten Ernährungswissenschaftlerin Dr. Ulrike Fisher auf wissenschaftlicher Basis entwickelt." [German] -> "Developed by doctoral nutritionist Dr. Ulrike Fisher with a scientific basis." Impact on sales was measured.

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

This was an experiment on the first checkout step where users would enter shipping information. The control had a longer footer with more additional sitewide links and a call to action to a newsletter. The variation removed these elements and kept the focus on the shipping information task. Impact on progression to next step and sales was measured.

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

In this experiment, popular products were shown at the top of the homepage. Impact to sale was measured.