Built-in Metrics

Below are the list of metrics calculated in Telmai out-of-box

Total Record Count

The total size of the monitored table. This is only available when CDC is enabled (i.e., the “delta only” flag is on). If the flag is off or the monitored source is not an SQL database, this field will be set to N/A.

Record Count

If CDC is enabled it reflects the size of the delta, otherwise, it's the size of the entire set of data.

Completeness

Percentage of not null/missing/placeholder values. Completeness is tracked both at the data source level as well as the attribute level:

  • Attribute level: percent of records where the attribute value is not null, not empty, or not one of the user-defined placeholders like N/A.

  • Data Source level: the compounded average of all attribute level completeness within a data source.

Freshness

Freshness is tracked both at data source and record level.

  • Record level freshness is defined by setting an expectation on a timestamp attribute within the data source (e.g.,. “Record Update Date” attribute to be no more than 1 month from now). To mark an attribute as a timestamp use the Advanced section of the Edit Connection menu. If the timestamp attribute is not configured this KPI will be N/A.

  • Table level freshness is based on the time since the table was last updated

Uniqueness

Uniqueness of the records based on an ID attribute. The KPI measures the ratio of records with unique id versus the total number of records. For example, if out of 10 records, there are 2 records sharing the same value the uniqueness is 80%.

An attribute can be marked as an ID attribute in the Advanced section of the Edit Connection menu. If ID attribute is not configured this KPI will be N/A

Contains PII

Value contains PII pattern for either of

  • Credit cards

  • IP Addresses

  • Social security numbers

  • Phone numbers

  • Zip codes

  • Email

  • Credit card

Length

String length

Last updated