All Latest 633 A/B Tests

MOST RECENT TESTS

Test #271 on Analytics-toolkit.co... by Georgi Z. GeorgievGeorgi Z. Georgiev Nov 24, 2019 Desktop Mobile Signup X.X% Signups

Georgi Tested Pattern #4: Testimonials On Analytics-toolkit.co...

 - Variant A
 - Variant B

In this experiment, the test variant showed 2 testimonials on the user registration / free trial registration page at Analytics-Toolkit.com

Total Sample: 2,432 Statistical Power at 5% MDE: 17.4%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #270 on Dentalplans.com by J.R. HernandezJ.R. Hernandez Nov 19, 2019 Desktop Listing X.X% Sales

J.R. Tested Pattern #37: List Or Grid View On Dentalplans.com

 - Variant A
 - Variant B

In this experiment, a list view was tested against a grid view.

Total Sample: 264,000 Statistical Power at 5% MDE: 48.1%

Test #269 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 15, 2019 Desktop Home & Landing X.X% Signups

Julian Tested Pattern #14: Exposed Menu Options On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the variation exposed 6 of the options from the pulldown menu as tabs.

Total Sample: 6,168 Statistical Power at 5% MDE: 6.7%

Test #268 on Backstage.com by Stanley ZuoStanley Zuo Nov 08, 2019 Mobile Listing X.X% Sales

Stanley Tested Pattern #14: Exposed Menu Options On Backstage.com

 - Variant A
 - Variant B

The change in this experiment was an exposed SEO panel (B) with a number of clickable filter options. 

Total Sample: 208,456 Statistical Power at 5% MDE: 97%

Test #267 on Backstage.com by Stanley ZuoStanley Zuo Nov 05, 2019 Mobile Checkout X.X% Sales

Stanley Tested Pattern #99: Progress Bar On Backstage.com

 - Variant A
 - Variant B

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.

Total Sample: 8,552 Statistical Power at 5% MDE: 6%

Test #266 on by Someone Someone Oct 25, 2019 Desktop Mobile Product X.X% Sales

Someone Tested Pattern #4: Testimonials

 - Variant A
 - Variant B

In this experiment, a product page showed customer reviews at the bottom of the page (B) instead of hiding them under a tab (A).

Total Sample: 17,139 Statistical Power at 5% MDE: 15.4%

Test #265 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Oct 17, 2019 Desktop Mobile Pricing X.X% Sales

Pierre Olivier Tested Pattern #112: Lower Price Frames On Poll-app.com

 - Variant A
 - Variant B

In this experiment, the $69 payment was explained as $6 per month over 1 year, and the $89 was explained as $4 per month over 2 years. 

Total Sample: 4,157 Statistical Power at 5% MDE: 7.9%

Test #264 on Kenhub.com by Niels HapkeNiels Hapke Oct 05, 2019 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

 - Variant A
 - Variant B

In this experiment users saw a sticky bar advertising the benefits of a Premium account across the bottom of the website, wherever they navigate. The sticky call to action appeared with a 4 second delay and was floating.

Total Sample: 50,572 Statistical Power at 5% MDE: 20.3%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

 - Variant A
 - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 Statistical Power at 5% MDE: 24.3%

Test #262 on Thomasnet.com by Julian GaviriaJulian Gaviria Oct 03, 2019 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #32: Condensed List On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the B version condensed the company listings. This was done by showing less of the description and introducing a "more" and "less" dynamic links that would expand and collapse the description.

Total Sample: 105,732 Statistical Power at 5% MDE: 8.6%

Test #105 on Inktweb.nl by Martijn OudMartijn Oud Sep 23, 2019 Desktop Mobile Signup X.X% Signups

Martijn Tested Pattern #111: Field Explanations On Inktweb.nl

 - Variant A
 - Variant B

In this experiment, onhover tooltip explanations were added to selected fields (Firstname, Lastname, Phone, Email and Password). One translation example of the Firstname tooltip was the following "Enter your first name (or letter) so that we can address you in a more personal way".

Total Sample: 3,169 Statistical Power at 5% MDE: 27.7%

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Sales

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

 - Variant A
 - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #260 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 16, 2019 Desktop Home & Landing X.X% Sales

Online Tested Pattern #45: Benefit Bar On Valkexclusief.nl

 - Variant A
 - Variant B

In this experiment on Valk Exclusief's web site, a transparent overview of the benefits for booking hotels was shown. The copy translates to: "Why should you book here? - 5€ Loyalty Discount - Best Price Guarantee - Discount On Packages - No Reservation Costs. Valk is a 150 year hotel chain in the Netherlands.

Test #258 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this variation an optional field label was added.

Total Sample: 5,965 Statistical Power at 5% MDE: 22.6%

Test #259 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

 - Variant A
 - Variant B
Total Sample: 5,890 Statistical Power at 5% MDE: 31.9%

Test #257 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 09, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #109: Required Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this followup experiment, field labels without and with a marked asterisk were tested.

Total Sample: 5,739 Statistical Power at 5% MDE: 31.3%

Test #256 on by Alex JamesAlex James Aug 23, 2019 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #109: Required Field Labels

 - Variant A
 - Variant B

The original had no fields marked as required. The variant had all fields marked as required with an asterisk (and a reference note).

Total Sample: 116,470 Statistical Power at 5% MDE: 75.4%

Test #255 on Thomasnet.com by Julian GaviriaJulian Gaviria Aug 22, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #109: Required Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, field labels without and with a marked asterisk were tested.

Total Sample: 5,977 Statistical Power at 5% MDE: 22.6%

Test #254 on Volders.de by Alexander KriegerAlexander Krieger Aug 16, 2019 Desktop Mobile Signup X.X% Revenue

Alexander Tested Pattern #17: Least Or Most Expensive First On Volders.de

 - Variant A
 - Variant B

In this experiment, 4 things were adjusted in the variation: the highest pricing plan was shifted to the left, it was set as the default one, the recommendation was also adjusted to point to the highest plan, and one benefit from the lowest plan was removed (customer support).

Test #40 on Adoramapix.com by Herman KleinHerman Klein Aug 13, 2019 Desktop Product X.X% Sales

Herman Tested Pattern #85: Benefit Button On Adoramapix.com

 - Variant A
 - Variant B

In this experiment only the button label changed. The control had a more immediate (next step-oriented) button label of "Upload Your Photos Now". The variation tried a more benefit-oriented button of "Order Now" (hinting at paying and obtaining the product).

Total Sample: 13,454 Statistical Power at 5% MDE: 43.7%