What is incrementality testing?

Incrementality testing is a marketing measurement method used to determine whether an advertising campaign actually caused additional conversions, sales, or other outcomes that would not have happened without the advertising. It helps distinguish the true impact of advertising from conversions that would have occurred naturally.

How Incrementality Testing Works

Typically, an audience is divided into two groups:

• Test group: Receives the advertising campaign.
• Control group: Does not receive the campaign or receives a controlled alternative.

The advertiser then compares the outcomes between the two groups. The difference represents the incremental impact of the advertising.

Key Benefits

• Measures true advertising impact: Shows whether ads caused additional business results.
• Separates organic conversions: Helps identify sales that would have happened without advertising.
• Improves budget allocation: Helps determine which channels or campaigns genuinely create additional value.
• Reduces over-attribution: Prevents advertisers from claiming credit for conversions that would have occurred anyway.
• Supports better decision-making: Provides evidence for scaling, reducing, or changing advertising investments.
• Useful across channels: Can be applied to paid search, social media, display, video, retail media, and other advertising channels.

Example

Suppose an ecommerce brand runs ads for 100,000 customers and keeps another similar group from seeing the ads.

• Ad-exposed group: 1,200 purchases
• Control group: 1,000 purchases

The additional 200 purchases can be considered incremental conversions, assuming the test was properly designed and the groups were comparable.

The incremental conversion rate can be calculated as:

Incremental Conversion Rate = (Test Group Conversion Rate − Control Group Conversion Rate)

Incrementality vs. Attribution

Attribution asks: “Which marketing touchpoint received credit for the conversion?”

Incrementality asks: “Did the advertising actually cause an additional conversion?”

In short: Incrementality testing helps advertisers understand the causal impact of advertising, making it a valuable approach for determining whether marketing spend is genuinely generating additional business results.