84 Tests By Jakub Linowski

  Founder @ GoodUI     Website   Twitter

Tests

Test #355 on by Jakub LinowskiJakub Linowski May 28, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #79: Product Highlights

 - Variant A
 - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 Statistical Power at 5% MDE: 30.7%

Test #347 on by Jakub LinowskiJakub Linowski Apr 07, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 Statistical Power at 5% MDE: 15.8%

Test #344 on by Jakub LinowskiJakub Linowski Mar 11, 2021 Desktop X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

 - Variant A
 - Variant B

Three common delivery questions were answered at the bottom of a checkout page. 

Total Sample: 18,871 Statistical Power at 5% MDE: 50.1%

Test #340 on by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

 - Variant A
 - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 Statistical Power at 5% MDE: 97.3%

Test #335 on by Jakub LinowskiJakub Linowski Jan 27, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #32: Condensed List

 - Variant A
 - Variant B

The variation here has more condensed product tiles being shown on a homepage. Two pieces of information were removed: product descriptions and past selections. Impact on product page visits and total sales was measured.

Total Sample: 20,943 Statistical Power at 5% MDE: 19.2%

Test #331 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this little experiment, an extra "Free Shipping" message was added on a product page. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 96,962 Statistical Power at 5% MDE: 83.6%

Test #332 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this experiment, an extra "Free Shipping" message was added on a product page - at the top of the buy box with an add-to-cart call to action. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 97,277 Statistical Power at 5% MDE: 83.7%

Test #324 on by Jakub LinowskiJakub Linowski Oct 30, 2020 Desktop Mobile X.X% Revenue

Jakub Tested Pattern #17: Least Or Most Expensive First

 - Variant A
 - Variant B

This experiment tested the order of purchase plans. The control version sorted the purchase options by the least expensive while the variation sorted them by the most expensive first. Impact on sales and revenue was measured.

Test #320 on by Jakub LinowskiJakub Linowski Oct 20, 2020 Desktop X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action

 - Variant A
 - Variant B

An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.

Total Sample: 2,908 Statistical Power at 5% MDE: 97.4%

Test #312 on by Jakub LinowskiJakub Linowski Aug 14, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #83: Progressive Fields

 - Variant A
 - Variant B

In this experiment, we tested a visible "Shipping Frequency" (A) option against a progressively displayed one (B) that would only appear after someone first chose a duration option. Thus in variation B, the buy box component would initially appear with fewer fields and smaller. The experiment measured initial progression and actual sales. 

Note on the data: the experiment was run a little shorter than usual, as one of the variations triggered a stop rule to protect losses (so the effect might be somewhat inflated from a lower power).

Total Sample: 2,861 Statistical Power at 5% MDE: 5.6%

Test #287 on Goodui.org by Jakub LinowskiJakub Linowski Mar 04, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #117: Company Logos On Goodui.org

 - Variant A
 - Variant B

In this experiment, a handful of customers and contributors from GoodUI were added on a pricing page to test the effect on sales.

Total Sample: 6,021 Statistical Power at 5% MDE: 4.4%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

 - Variant A
 - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 Statistical Power at 5% MDE: 24.3%

Test #251 on Goodui.org by Jakub LinowskiJakub Linowski Jul 25, 2019 Desktop Mobile X.X% Signups

Jakub Tested Pattern #57: Maybe Later On Goodui.org

 - Variant A
 - Variant B

In this experiment, we tested a standard modal (with 2 choices) against a "Maybe Later" one (with 3 choices). One of the choices in the variant allowed users to postpone their decision with a "maybe" which would enable a floating bar at the bottom of the screen. Clicking on any of the "Yes" options would send people to the bottom of the screen with an email signup form. Increasing signup was our primary measure. Both modals also appeared instantly after a page load.

Total Sample: 7,759 Statistical Power at 5% MDE: 7.2%

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

 - Variant A
 - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Total Sample: 25,046 Statistical Power at 5% MDE: 22.6%

Test #237 on Goodui.org by Jakub LinowskiJakub Linowski Apr 29, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #103: Money Back Guarantee On Goodui.org

 - Variant A
 - Variant B
Total Sample: 21,096 Statistical Power at 5% MDE: 6%

Test #230 on Goodui.org by Jakub LinowskiJakub Linowski Mar 09, 2019 Desktop Mobile X.X% Engagement

Jakub Tested Pattern #56: Hover Button On Goodui.org

 - Variant A
 - Variant B

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Total Sample: 30,699 Statistical Power at 5% MDE: 98.1%

Test #229 on by Jakub LinowskiJakub Linowski Mar 08, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #99: Progress Bar

 - Variant A
 - Variant B
Total Sample: 11,214 Statistical Power at 5% MDE: 13%

Test #228 on by Jakub LinowskiJakub Linowski Mar 05, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #99: Progress Bar

 - Variant A
 - Variant B

The variation added a progress bar to one of the checkout steps for a ticket ordering site.

Total Sample: 12,961 Statistical Power at 5% MDE: 14.7%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

 - Variant A
 - Variant B
Total Sample: 11,616 Statistical Power at 5% MDE: 3.6%

Test #153 on Goodui.org by Jakub LinowskiJakub Linowski Feb 19, 2018 Desktop Mobile X.X% Signups

Jakub Tested Pattern #58: Full Height False Bottom On Goodui.org

 - Variant A
 - Variant B
Total Sample: 11,330 Statistical Power at 5% MDE: 8.6%