Incrementality

Definition

Incrementality in advertising measurement refers to the causal impact of a marketing or advertising effort beyond what would have occurred without it. It quantifies the additional revenue, conversions, or customer actions that can be directly attributed to an ad campaign, rather than organic growth or baseline performance. Measuring incrementality helps advertisers determine whether their ad spend is genuinely driving new business or merely capturing demand that would have occurred anyway.

Incrementality is a critical concept in evaluating Return on Advertising Spend (ROAS) and Return on Investment (ROI), as it separates true ad-driven outcomes from natural customer behavior.

Watch the Video

Why Incrementality Matters

1. Separating Correlation from Causation
   • Traditional advertising metrics, such as last-click attribution, often assume that all conversions are a direct result of ad exposure. Incrementality testing helps determine whether those conversions would have happened even without the ad.
2. Optimizing Media Spend
   • By identifying which channels, campaigns, and strategies drive real business outcomes, marketers can allocate budgets more effectively, reducing wasted ad spend.
3. Evaluating ROAS More Accurately
   • A high ROAS on a campaign does not necessarily mean the campaign is incremental. If an ad is only capturing demand from users who were already going to convert, the actual return on investment is lower than reported.
4. Understanding Cross-Channel Effects
   • Incrementality analysis can reveal how different marketing channels interact, ensuring that marketers invest in the most effective touchpoints in the customer journey.
5. Justifying Marketing Investment
   • Proving that an ad campaign is truly driving new customers or revenue strengthens the case for continued or increased investment in digital advertising.

Methods for Measuring Incrementality

1. Randomized Control Trials (RCTs) / Holdout Tests
   • A scientifically rigorous method where one group of users is exposed to ads, while another (the control group) is not. The difference in performance between the two groups determines the true incremental impact of the ads.
2. Geographic Lift Studies
   • Advertisers run campaigns in selected geographic regions while keeping others as a control group. Comparing sales or conversions across regions helps measure incremental lift.
3. Time-Based Lift Analysis
   • A campaign is turned on and off at different times, and performance is analyzed before, during, and after to estimate the incremental impact.
4. Ghost Ads / PSA Testing
   • In platforms like Google and Meta, advertisers can serve “ghost ads” (non-promotional placeholders) to a control group while showing real ads to a test group. This technique isolates the impact of the actual campaign.
5. Regression-Based Attribution Models
   • Advanced statistical models analyze historical campaign data, controlling for external factors such as seasonality, organic traffic, and market trends to estimate incremental effects.

Incrementality vs. Attribution

• Attribution assigns credit for conversions across different touchpoints but does not necessarily prove causality. It often relies on models like last-click, multi-touch, or data-driven attribution.
• Incrementality determines whether those conversions would have happened without the ad, proving the true cause-and-effect relationship.

Many advertisers use incrementality testing to validate and improve their attribution models, ensuring that marketing budgets are spent effectively.

Incrementality’s Role in ROAS and ROI

1. Refining ROAS Calculation
   • ROAS (Return on Advertising Spend) is typically calculated as:
     • ROAS = Revenu from Ads / Ad Spend
   • However, if a large percentage of that revenue would have occurred without the ad, the incremental ROAS is much lower than the reported ROAS.
2. Accurate ROI Measurement
   • ROI (Return on Investment) considers the profitability of ad spend:
     • ROI = (Incremental Profit from Ads−Ad Spend) / Ad Spend​
   • If the true incremental impact of an ad campaign is low, the ROI may be negative, meaning the campaign is not actually profitable.
3. Understanding True Customer Acquisition Costs (CAC)
   • Without incrementality testing, CAC may be underestimated. Knowing which ad strategies drive net-new customers helps optimize acquisition costs.

Challenges in Measuring Incrementality

1. Data Availability & Experimentation Limitations
   • Running holdout tests requires clean data and control over ad distribution, which may not always be feasible.
2. External Factors
   • Economic conditions, seasonality, and competitor activity can influence campaign performance, making it difficult to isolate the incremental effect of ads.
3. Multi-Touchpoint Customer Journeys
   • Customers interact with multiple channels before converting. Measuring incrementality accurately across all touchpoints requires sophisticated modeling.
4. Ad Platform Restrictions
   • Some advertising platforms limit access to user-level data, making it harder to run controlled experiments outside their ecosystem.

Future of Incrementality Measurement

1. AI-Driven Attribution & Lift Studies
   • Machine learning models are improving the accuracy of incrementality predictions, allowing for real-time optimization of marketing spend.
2. Privacy-First Measurement
   • With increasing restrictions on third-party cookies and tracking, privacy-friendly methods such as synthetic control groups and clean room analytics will become more prevalent.
3. More Accessible Experimentation
   • Platforms like Google, Meta, and Amazon are developing built-in incrementality measurement tools to help advertisers validate their campaigns.

Incrementality is essential for determining the real impact of advertising efforts and avoiding misleading performance metrics. By measuring the true causal effect of campaigns, advertisers can optimize their ROAS, ROI, and marketing spend to drive genuine business growth. As digital advertising evolves, incrementality testing will remain a cornerstone of effective data-driven marketing strategies.

Related

• Average Order Value (AOV)
• Average Revenue Per User (ARPU)
• Bounce Rate
• Churn Rate (CR)
• Clickthrough Rate (CTR)
• Conversion Rate (CR)
• Cost Per Acquisition (CPA)
• Cost Per Lead (CPL)
• Customer Lifetime Value (CLV)
• Customer Satisfaction Score (CSAT)
• Direct-to-Consumer Advertising Spend (DAS)

Resources

Marketing Measurement and Analytics by Greg Kihlström (De Gruyter, 2024)