7 Tests By Alex James

  Senior UX Manager   Twitter

Tests

Test #341 on by Alex JamesAlex James Feb 25, 2021 Desktop Mobile X.X% Signups

Alex Tested Pattern #35: Floating Labels

 - Variant A
 - Variant B

This experiment shows a comparison between floating-field labels vs top-aligned labels. Form labels first appeared inlineĀ and as users would begin typing, they floated to the top of the field. In the other version, fixed field labels were shown above the form fields at all times. Impact on signups was measured.

Total Sample: 579,148 Statistical Power at 5% MDE: 99.9%

Test #256 on by Alex JamesAlex James Aug 23, 2019 Desktop Mobile X.X% Signups

Alex Tested Pattern #109: Required Field Labels

 - Variant A
 - Variant B

The original hadĀ no fields marked as required. The variant had all fields marked as required with an asterisk (and a reference note).

Total Sample: 116,470 Statistical Power at 5% MDE: 75.4%

Test #242 on by Alex JamesAlex James May 27, 2019 Desktop Mobile X.X% Signups

Alex Tested Pattern #7: Social Counts

 - Variant A
 - Variant B
Total Sample: 79,012 Statistical Power at 5% MDE: 56.8%

Test #236 on by Alex JamesAlex James Apr 04, 2019 Desktop X.X% Signups

Alex Tested Pattern #9: Multiple Steps

 - Variant A
 - Variant B

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Total Sample: 282,316 Statistical Power at 5% MDE: 92%

Test #234 on by Alex JamesAlex James Apr 01, 2019 Desktop X.X% Leads

Alex Tested Pattern #101: Search Keyword Highlighting

 - Variant A
 - Variant B

In this experiment, a different style for keyword highlighting was used.

Total Sample: 738,295 Statistical Power at 5% MDE: 99.9%

Test #224 on by Alex JamesAlex James Feb 11, 2019 Desktop X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

 - Variant A
 - Variant B

This experiment reduced the search form by removing the distance field.

Total Sample: 97,074 Statistical Power at 5% MDE: 99.9%

Test #220 on by Alex JamesAlex James Jan 18, 2019 Desktop X.X% Leads

Alex Tested Pattern #34: Open In A New Tab

 - Variant A
 - Variant B

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Total Sample: 55,703 Statistical Power at 5% MDE: 99.9%