Built-in Metrics
Below are the list of metrics calculated in Telmai out-of-box
Total Record Count
The total size of the monitored table. This is only available when CDC is enabled (i.e., the “delta only” flag is on). If the flag is off or the monitored source is not an SQL database, this field will be set to N/A.
Record Count
If CDC is enabled it reflects the size of the delta, otherwise, it's the size of the entire set of data.
Completeness
Percentage of not null/missing/placeholder values. Completeness is tracked both at the data source level as well as the attribute level:
Attribute level: percent of records where the attribute value is not null, not empty, or not one of the user-defined placeholders like N/A.
Data Source level: the compounded average of all attribute level completeness within a data source.
Freshness
Freshness is tracked both at data source and record level.
Record level freshness is defined by setting an expectation on a timestamp attribute within the data source (e.g.,. “Record Update Date” attribute to be no more than 1 month from now). To mark an attribute as a timestamp use the Advanced section of the Edit Connection menu. If the timestamp attribute is not configured this KPI will be N/A.
Table level freshness is based on the time since the table was last updated
Uniqueness
Uniqueness of the records based on an ID attribute. The KPI measures the ratio of records with unique id versus the total number of records. For example, if out of 10 records, there are 2 records sharing the same value the uniqueness is 80%.
An attribute can be marked as an ID attribute in the Advanced section of the Edit Connection menu. If ID attribute is not configured this KPI will be N/A
Contains PII
Value contains PII pattern for either of
Credit cards
IP Addresses
Social security numbers
Phone numbers
Zip codes
Email
Credit card
Length
String length
Last updated