All Latest 650 A/B Tests

This experiment was ran on the initial onboarding screens of the Elevate App - right after installing and launching the app for the first time. The change was the removal of subtle "skip" links that fast tracked users to the signup/login screen (Get Started). Hence in the variation, all users had to scroll through the 4 introductory messages before being asked to create an account.

In this experiment on a contract cancellation funnel, one field was removed - a secondary contract ID. The control and variation both had a primary "customer ID" with which to identify and cancel someone's contract with.

This experiment tests the impact of a different paywall screen on iOS. The current control paywall screen for 100% of iOS users was the animated pro screen. In this screen, users see an animation that gives shows glimpses of several Elevate games in action, as well as a bulleted list of key selling points for Pro. The proposed change (variant B) features a swipeable carousel of pages where each page has an image and some accompanying text explaining a different benefit of subscribing to Pro. The hypothesis is that we can lift conversion by showing users the alternate swiping paywall screen.

In this experiment, the test variant showed 2 testimonials on the user registration / free trial registration page at Analytics-Toolkit.com

In this experiment, onhover tooltip explanations were added to selected fields (Firstname, Lastname, Phone, Email and Password). One translation example of the Firstname tooltip was the following "Enter your first name (or letter) so that we can address you in a more personal way".

In this variation an optional field label was added.

In this followup experiment, field labels without and with a marked asterisk were tested.

The original had no fields marked as required. The variant had all fields marked as required with an asterisk (and a reference note).

In this experiment, field labels without and with a marked asterisk were tested.

In this experiment, a version without a back button was tested against a one where it was positioned in the upper left corner. This test occured on a second step of a contract cancellation service.

In this experiment, an editable contract cancellation letter was tested against a non-editable one. The editable letter first appeared in a text state, which required a click on a link in order for it to be transformed into an editable textarea field.

This test explored a progressive disclosure interaction in variation B. When a user started typing text into the first field, two more fields expanded into view.

In this experiment a more elaborate and authentic testimonial was used instead of three more generic ones from social media sites.

In this experiment, a free study guide ebook was promoted on a registration page.

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email. 

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows:

1. Fill out the termination
2. Send termination
3. Proof of termination

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.