All Latest 650 A/B Tests

In this experiment, existing reassurance copy was changed. The control contained copy that focused on splitting payments and paying over time. The variation challenged this and showed a best price guarantee and the ability to earn credits. 

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

In this experiment, the order of the checkout flow was rearranged. In the control the first step of the checkout flow started with the shipping information step, followed by greeting card selection. In the variation this was rearranged (hypothesis was that the greeting card step was easier). Impact on sales was measured.

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

In this experiment, the effect of having additional static category themed images was tested on category listing pages. Impact on sales was measured.

In this experiment, a higher contrast search bar with a blue border and a filled blue button style was tested against a more feint style.  Impact on searches and purchases was measured. (A/B test was inverted to B/A in order to fit the filled-vs-ghost button pattern).

In this experiment, a photo of a doctor (who researched and created the a cleanising juice - the product) was appended after the add to cart button. The copy is translated as follows from "Von der promovierten Ernährungswissenschaftlerin Dr. Ulrike Fisher auf wissenschaftlicher Basis entwickelt." [German] -> "Developed by doctoral nutritionist Dr. Ulrike Fisher with a scientific basis." Impact on sales was measured.

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

This was an experiment on the first checkout step where users would enter shipping information. The control had a longer footer with more additional sitewide links and a call to action to a newsletter. The variation removed these elements and kept the focus on the shipping information task. Impact on progression to next step and sales was measured.

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

In this experiment, popular products were shown at the top of the homepage. Impact to sale was measured.