Skip to main content

Free A/B/n Testing Tool with Statistical Significance

TotallyMoney have produced a free split testing tool for A/B/n tests which allows you to find the statistical significance of your results and visualise their uncertainty. Step by step guide to analysing the results of your A/B/n test:

1. Make a copy of our tool from Google Sheets

2. Input the number of visitors and conversions (or impressions and clicks etc.) for your control and one or more variations

3. The variation with the highest conversion rate will be returned as the winner, with its confidence level and statistical significance, as well as whether it is over 95% or 99% certain that your results were not down to chance

4. Bear in mind that when conducting an A/B/n test, the question we are asking is ‘can we reject the hypothesis that the different variations have the same conversion rate as the control, given the observed conversion rates?’

5. If you would like to visualise the probability distributions of the winning variation and control (or the runner up if the control wins), then click the ‘Update Axes’ button on the graph and follow the instructions at the bottom of the sheet to activate the script


We're on a mission to help everyone move their finances forward and gain financial momentum.

TotallyMoney is an independent credit broker, not a lender. Our comparison service works with most leading lenders, covering the majority of the market. Though we may be paid a fee by lenders or brokers this never influences how our products are ranked.

We don't provide financial advice. Product information is obtained from independent sources and rates displayed may vary depending on your personal circumstances. While we make every effort to ensure that information is up to date, you should always confirm the terms of the offer with the product provider.

TotallyMoney is owned and operated by TotallyMoney Limited which is registered in England and Wales (Company Registration Number 06205695). TotallyMoney Limited is an Appointed Representative of TM Connect Limited, which is registered in England and Wales (Company Registration Number 06967012) and authorised and regulated by the Financial Conduct Authority in respect of consumer credit related activities (FCA FRN: 511936). Trading Address and Registered Office: Chapter House, 16 Brunswick Place, London N1 6DZ. Credit is available, subject to status, only to UK residents aged 18 or over.

We use cookies as described in our Cookie Policy. Continue browsing or click to accept.