Incrementality Test Calculator

About the Incrementality Test Calculator

Incrementality testing is the gold standard for measuring the true causal impact of marketing campaigns. By randomly splitting your audience into a test group (exposed to the campaign) and a control group (not exposed), you can measure the lift in conversion rates directly attributable to your marketing — not just correlated with it.

This calculator takes the conversion rates of your test and control groups and computes the incremental lift, incremental conversion rate, and the number of conversions that would not have happened without the campaign. The result tells you the true, causal value of your marketing spend.

Incrementality tests are essential for validating attribution model accuracy and ensuring that your marketing budget is actually driving additional business rather than just capturing conversions that would have happened organically. Every mature marketing organization should run incrementality tests regularly.

Quantifying this parameter enables systematic comparison across campaigns, channels, and time periods, revealing opportunities for optimization that drive sustainable business growth.

When This Page Helps

Attribution models show correlation, but incrementality tests prove causation. This calculator helps you measure the true incremental impact of your marketing campaigns, ensuring you invest in channels that actually drive additional business.

How to Use the Inputs

1. Enter the number of users in the test (exposed) group.
2. Enter the number of conversions in the test group.
3. Enter the number of users in the control (holdout) group.
4. Enter the number of conversions in the control group.
5. View the incremental lift percentage and incremental conversions.
6. Calculate the cost per incremental conversion by adding campaign spend.

Example Calculation

Tips & Best Practices

• Ensure random assignment between test and control groups for valid results.
• Run tests for at least 2–4 weeks to account for day-of-week and paycheck effects.
• Keep control groups at 10–20% of total audience for sufficient statistical power.
• Test one variable at a time for clear causal conclusions.
• Use incrementality tests to validate your attribution model accuracy periodically.
• Calculate cost per incremental conversion to compare with your CPA targets.
• Account for statistical significance — small samples can produce misleading lift numbers.

Why Incrementality Testing Matters

Many marketing channels take credit for conversions that would have happened regardless. Retargeting, for example, often targets users who were already likely to convert. Brand search captures high-intent users who would have found you anyway. Incrementality testing strips away this false credit and reveals the true causal impact.

Designing Effective Tests

A well-designed incrementality test requires: random assignment to test and control groups, sufficient sample size for statistical significance, a clean holdout where the control group truly has no exposure, and enough time to capture the full conversion lag. Work with your analytics team to ensure proper experiment design.

Interpreting Results

A positive lift means your campaign drives incremental conversions. But always calculate cost per incremental conversion to determine if the lift is economically viable. A 50% lift sounds impressive, but if the cost per incremental conversion exceeds your target CPA, the campaign may not be worth scaling.

Frequently Asked Questions

• What is an incrementality test?

  An incrementality test is a controlled experiment that measures the true causal impact of marketing by comparing a test group (exposed to a campaign) with a control group (not exposed). The difference in conversion rates represents the incremental lift caused by the marketing.

• How is incrementality different from attribution?

  Attribution models distribute credit based on observed touchpoints but cannot prove causation. Incrementality tests use randomized controlled experiments to measure actual causal impact. A channel might get attribution credit for conversions that would have happened anyway.

• How large should my control group be?

  Control groups typically represent 10–20% of your total audience. Larger control groups provide more statistical power but reduce the campaign's reach. Use a sample size calculator to determine the minimum control size needed for your desired confidence level.

• How long should an incrementality test run?

  Run tests for at least 2–4 weeks to capture weekly patterns and reach statistical significance. For seasonal businesses, consider running tests during representative periods. Avoid holidays or unusual events that could skew results.

• What is a good incremental lift?

  Acceptable lifts vary by channel and campaign type. Display ads might show 5–20% lift, paid social 10–30%, and email 15–50%. A "good" lift depends on whether the cost per incremental conversion is below your target CPA.

• Can I measure incrementality for all channels?

  Most digital channels support incrementality testing through holdout experiments. Facebook, Google, and programmatic platforms have built-in tools. For SEO and organic social, geographic or time-based quasi-experiments can approximate incrementality.