Incrementality Testing: Measure True Marketing Impact

Beyond attribution: understanding what your marketing actually creates.

By Dr. James Mitchell December 2024 18 min read

Attribution tells you which touchpoints were present before a conversion. Incrementality tells you which actually caused it. The difference can be millions in misallocated budget.

20-50%
Typical Over-Attribution
2-3x
ROAS Gap
30%+
Budget Waste

The Attribution Problem

Attribution assumes correlation equals causation. If a user saw your ad and converted, the ad gets credit. But would they have converted anyway? Studies show 20-50% of attributed conversions would have happened organically.

Types of Incrementality Tests

Sample Size Matters

You need roughly 400 conversions per group to detect a 20% lift with 80% statistical power. Underpowered tests waste time and money.

Calculating True ROI

If attribution shows 3x ROAS but only 40% is incremental, true ROAS = 3.0 × 0.4 = 1.2x. That "profitable" campaign barely breaks even.

Measure What Matters

ClicksFlyer helps you understand true marketing impact by combining attribution with incrementality insights.