Ga naar de hoofdinhoud

Sort checks by the failure they catch

Classify common data quality checks by the type of pipeline failure they are designed to catch.

data-pipeline-engineering4 min read

Place each quality check in the bucket that describes the main failure it catches. Freshness Completeness Validity Reconciliation Latest event_date partition must be available by 06:30 UTC Order count for the day must be within 5 percent of the payment gateway export order_status must be one of paid, shipped, refunded, or canceled Sum of invoice total in the mart must match Finance close file within $500 No more than 0.1 percent of rows may have a null account key The country_code field must be a two-letter ISO-style code Hourly clickstream pane must arrive within 20 minutes of the hour Daily…

Read the full lesson

Sign up free: one personalized lesson every day, matched to your role and goals.

← Back to library

Neem contact op