Skip to content

Maayan via Elementary: Add upstream data quality tests for cpa_and_roas pipeline#923

Open
joostboon wants to merge 1 commit intomasterfrom
elementary-add-upstream-tests-cpa-and-roas-482917-10e2f5bd-6c24-4dab-8b7b-1a4e466e9178
Open

Maayan via Elementary: Add upstream data quality tests for cpa_and_roas pipeline#923
joostboon wants to merge 1 commit intomasterfrom
elementary-add-upstream-tests-cpa-and-roas-482917-10e2f5bd-6c24-4dab-8b7b-1a4e466e9178

Conversation

@joostboon
Copy link
Copy Markdown
Collaborator

Summary\n\nAdds volume and freshness anomaly monitoring to key staging models in the cpa_and_roas upstream lineage.\n\n## Changes\n\n### stg_orders\n- Volume anomaly — catches unexpected row count changes at the earliest stage of the orders pipeline\n- Freshness anomaly — ensures order data is arriving on schedule before it flows into downstream financial models\n\n### stg_payments\n- Volume anomaly — detects ingestion issues in payment data that would silently corrupt order amounts and ROAS\n- Freshness anomaly — ensures payment data freshness so downstream financial metrics stay current\n\n## Context\n\nThese staging models are 5 levels upstream of the critical cpa_and_roas model. Without monitoring at this layer, pipeline failures or data delays would propagate undetected through orderscustomer_conversionscpa_and_roas, corrupting cost-per-acquisition and return-on-ad-spend calculations.

Created by: maayan+172@elementary-data.com

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant