Skip to content

Advertisement
Advertisement unavailable offline
The page content remains available.

A/B test planning — sample size, MDE and duration

Enter baseline conversion, expected uplift, power, confidence and daily traffic.

Required sample per variant: —

Fill in the fields above — the result is computed on this page.

Target conversion
—
Absolute difference
—
Total sample
—
Estimated duration in days
—
MDE for available sample
—
Absolute MDE
—

Planned and detectable effect

Scenario Baseline Target n per variant
Fill in the fields above — the result is computed on this page.
What do these numbers mean?
  • A 10% relative uplift from 10% means an 11% target, an absolute difference of 1 percentage point.
  • Higher power and confidence require a larger sample.
  • Pre-register the metric, duration and analysis before launch.

The formula uses a normal approximation, equal allocation and independent users. It does not account for repeated peeking, clustering or multiple metrics.

How do I use this page?
  1. Enter baseline conversion from 0 to 1.
  2. Set the smallest relative effect that matters.
  3. Review sample size, MDE and duration, then set a complete schedule.

What this page does not do: The formula uses a normal approximation, equal allocation and independent users. It does not account for repeated peeking, clustering or multiple metrics.

Further reading

Theory — how is sample size planned for an A/B test?

The plan calculates the number of observations needed to compare two independent proportions with a two-sided test, based on baseline conversion, expected uplift, statistical power, confidence level and daily traffic. The MDE value shows the smallest relative uplift that the given available sample can detect at the chosen power. Test duration is calculated by dividing the total required sample by daily traffic. Conversion rates and relative uplift are entered as fractions, so 0.1 means 10 percent.

Frequently asked questions

Does 0.1 mean 10%?
Yes. Enter conversion and relative uplift as proportions.
Can I stop the test early?
Only under a pre-planned sequential method. Ordinary repeated peeking inflates false-positive risk.

See also

← All calculators

Advertisement
Advertisement unavailable offline
The page content remains available.
Offline app and draw notifications

My saved selections

Selections saved only in this browser. Numbers are shown exactly as saved; this is not a lottery ticket.

Open the My saved selections hub
Restore with preview

Restore in the hub: review the file and confirm first. Both old backups and the complete selections + journal backup are supported. Nothing is uploaded.