Pattern #116: Links Or Buttons

Pattern #116  Tested 2 timesTested by Stanley Zuo on Dec 29, 2020

Based on 2 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Links Or Buttons (Variant A) Links Or Buttons (Variant B)

Expected Median Effects Of B

X.X%

Progression

(2 tests)

-

Leads

X.X%

Signups

(1 tests)

-

Engagement

X.X%

Sales

(1 tests)

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(2 tests)

All 2 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

51.7% of 90% cumulative power target at 2% MDE from 2 tests Help replicate this with an A/B test

90%
↓
42.1% 16.5%
Listing 1 test: X%
Content 1 test: X%

Tested on

Tests

Replaced

Isolated

Test # 330 on Backstage.com by Stanley ZuoStanley Zuo Dec 29, 2020 Test link

Find Out How It Did With 98,697 Visitors

  • Measured by clicks on "Apply Here"

  • Measured by email registrations

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Links Or Buttons - Variant A A
Links Or Buttons - Variant B B
Content
Statistical Power by Minimum Detectable Effect
4%0.5%
7.1%1%
16.5%2%
68.9%5%
80%5.7%
99.8%10%
99.9%15%
99.9%20%

In this simple experiment on a content page, links were turned into more prominent buttons. The experiment measured clicks and signups.

Get Access To See The Test Results

Replaced

Isolated

Test # 281 on Backstage.com by Stanley ZuoStanley Zuo Jan 31, 2020 Test link

Find Out How It Did With 386,439 Visitors

  • Measured by clicks on view detail links

  • Measured by subscription flow starts

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Links Or Buttons - Variant A A
Links Or Buttons - Variant B B
Listing
Statistical Power by Minimum Detectable Effect
6%0.5%
14.1%1%
42.1%2%
80%3.2%
99.2%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, multiple view detail links for a listing tile were turned into higher contrast buttons. 

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.