Skip to content

Advertisement
Advertisement unavailable offline
The page content remains available.

A/B test calculator

Enter successes and total users for variants A and B. The result compares two independent proportions.

Two-sided p value: —

Fill in the fields above — the result is computed on this page.

Conversion A
—
Conversion B
—
Difference B − A
—
Relative uplift
—
z statistic
—
Lower difference bound
—
Upper difference bound
—
Significant at chosen level (1 = yes)
—

Variant conversion rates

Bars show the observed success share for variants A and B.

Variant data

Variant Successes Sample size Conversion
Fill in the fields above — the result is computed on this page.
What do these numbers mean?
  • A difference interval containing zero is inconclusive at the selected confidence level.
  • Relative uplift can appear large from a small baseline, so report the absolute difference too.

The normal approximation is intended for independent groups and adequate counts. It does not handle paired data, repeated peeking or multiplicity across metrics.

How do I use this page?
  1. Enter successes and totals for A and B.
  2. Choose the confidence level specified before analysis.
  3. Read the difference, interval and p value.

What this page does not do: The normal approximation is intended for independent groups and adequate counts. It does not handle paired data, repeated peeking or multiplicity across metrics.

Further reading

Theory — how does the A/B proportion test work?

The calculator compares successes and total users in variants A and B as a test of two independent proportions. It checks the hypothesis that the success probability is equal in both variants — the p-value describes how well the data fit this hypothesis, while the confidence interval shows the range of plausible differences B minus A. A smaller p-value does not mean a larger effect, since it also depends on sample size; the absolute difference between variants shows the effect size.

Frequently asked questions

Does a smaller p value mean a larger effect?
No. The p value also depends on sample size. Use the absolute difference, uplift and confidence interval for effect size.
Can I stop as soon as p falls below 0.05?
Repeated unplanned peeking raises false-positive risk. Fix a duration or sample size in advance, or use a sequential method.

See also

← All calculators

Advertisement
Advertisement unavailable offline
The page content remains available.
Offline app and draw notifications

My saved selections

Selections saved only in this browser. Numbers are shown exactly as saved; this is not a lottery ticket.

Open the My saved selections hub
Restore with preview

Restore in the hub: review the file and confirm first. Both old backups and the complete selections + journal backup are supported. Nothing is uploaded.