Telmai Academy
  • Data Quality and Observability Academy
  • Basics of Data Observability
  • Data Quality Indicators
    • Introduction - Indicators of Data Quality
    • Selecting Data Quality Indicators
    • Completeness
    • Uniqueness
    • Freshness
    • Validity
    • Accuracy
    • Consistency
    • Data Lineage
  • Advanced Topic: Implementing DQ indicators
    • Completeness
      • Built-in
      • User-Defined
  • Correctness
    • Categorical (Nominal or Ordinal)
    • Numerical (Discrete or Continuous)
    • Structured
    • Semi-Structured
    • Unstructured
    • Uncommon Types
    • Designated Values
  • Profiling data
    • Basics of profiling
    • Interactive Profiling
  • Monitoring data quality
  • Monitoring definitions
    • SLO
    • SLI
    • Policies
    • Setting up policies and alerting
  • Monitoring Sources
Powered by GitBook
On this page

Was this helpful?

  1. Data Quality Indicators

Validity

Data is valid if it conforms to a specific syntax or rules. For data to be valid, it should be collected according to predefined rules and parameters, and should conform to the right format and be within the right range to be valid.

Various Definitions:

Data values are consistent with a predefined domain of values like controlled pick-list or reference data values for example : ISO-3166.

Data is valid if it conforms to the syntax (format, type, range) of its definition. For example, Date format DD-MM-YYYY

Data is valid if it conforms to defined business rules. For example, cancelation date < travel date Conformance of data to the structure of data.

Measuring Validity

All data can typically be measured for Validity. Validity applies at the data item level, record level (for combinations of valid values), as well as metadata.

Unit of Measure: Percentage of data items valid.

Related dimensions: Accuracy, Completeness, Consistency and Uniqueness

Notes Data may also be valid only for a specific length of time. For example data that is generated from RFID or scientific datasets.

PreviousFreshnessNextAccuracy

Last updated 3 years ago

Was this helpful?