All Latest 650 A/B Tests

In this experiment, the number of displayed tile results were modified (fewer vs more listing tiles shown per page). Impact on lead starts and lead completions were measured (Mobilesegment).

In this experiment, the number of displayed tile results were modified (fewer vs more listing tiles shown per page). Impact on lead starts and lead completions were measured (Desktop segment).

In this experiment, the favorite icons (hearts) were: 1) highlighted more prominently using a darker border color, and 2) when users hovered over them with a mouse, the heart icon filled with a red color. Impact on favorite clicks, adds to cart and sales was measured.

This experiment ran on search results page of an ecommerce grocery store.

50% of users saw product cards that upon clicking would open in the same window (Control).

The other 50% saw product cards that upon clicking would open in a new tab/window (Treatment).

Impact on adds to cart and orders was measured.

We should also add that this experiment was run as part of the Trustworthy Replication Project and only "adds-to-cart" were pre-registered as the primary metric - https://osf.io/yu4gm/overview

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

In this experiment, search results and listing pages received two additional filters to remove out-of-stock and in-store-only items. This reduced the number of results shown by default. The impact on add-to-cart actions, checkout flows, and completed sales was measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this experiment, a static category theme image at the top of a listing page was tested against the same page but without the extra image. Impact on sales was measured.

In this experiment, the effect of having additional static category themed images was tested on category listing pages. Impact on sales was measured.

In this desktop experiment, 4 product tiles per page (control) were tested against 6. Impact on sales was measured.

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.