All Latest 650 A/B Tests

In this experiment, the favorite icons (hearts) were: 1) highlighted more prominently using a darker border color, and 2) when users hovered over them with a mouse, the heart icon filled with a red color. Impact on favorite clicks, adds to cart and sales was measured.

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment compared the checkout experience with and without a limited-time countdown timer. Impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

This was a sibling experiment on another domain.

This experiment ran on search results page of an ecommerce grocery store.

50% of users saw product cards that upon clicking would open in the same window (Control).

The other 50% saw product cards that upon clicking would open in a new tab/window (Treatment).

Impact on adds to cart and orders was measured.

We should also add that this experiment was run as part of the Trustworthy Replication Project and only "adds-to-cart" were pre-registered as the primary metric - https://osf.io/yu4gm/overview

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment showed a single testimonial and impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

In this experiment, users were able to auto-generate gift messages during the checkout flow based on input fields above. For this reason, the message input area was also shifted further down beyond the initial fields.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

In this experiment (sibling of 656), a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, square buttons were changed to rounded ones throughout the full site. Impact on adds-to-cart was measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

In this experiment, more popular search categories (pills) were shown on the homepage based on analyzed search volume. Impact on searches and email subscriptions were measured.

A global flyout drawer was added that consolidated sale promotions into one centralized location, replacing the customary placement of promotions throughout the site.

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

A floating Add to Basket button was added to a product page. Impact on sales was measured.

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.