Skip to main content
DATA-PIPELINE-ENGINEERING4 MIN READ

Sort checks by the failure they catch

Classify common data quality checks by the type of pipeline failure they are designed to catch.

Place each quality check in the bucket that describes the main failure it catches. Freshness Completeness Validity Reconciliation Latest event_date partition must be available by 06:30 UTC Order count for the day must be within 5 percent of the payment gateway export order_status must be one of paid, shipped, refunded, or canceled Sum of invoice total in the mart must match Finance close file within $500 No more than 0.1 percent of rows may have a null account key The country_code field must be a two-letter ISO-style code Hourly clickstream pane must arrive within 20 minutes of the hour Daily…

Read the full lesson

Sign up free — one personalized lesson every day, matched to your role and goals.

Already have an account? Sign in

← Back to library
Contact us