Firebolt
Introduction
Firebolt is a cloud data warehouse purpose-built to provide sub-second analytics performance on massive, terabyte-scale data sets.
Telmai monitors the data in the Firebolt instance to identify anomalies like outliers and drifts.
Telmai is designed to read your data once and process it outside your DW architecture to reduce any monitoring load on your Firebolt DW.
This article outlines the integration steps with Firebolt.
1 : Create user account
Create a user of type viewer inside Firebolt (Reference: How to add a user? , How to change user role? )
Validate that the user has access to the database tables which you would be using inside telmai by logging in with the specific user created from the SQL workbench of Firebolt and validating the access.
2: Import data
Now add the above source to Telmai using REST API or UI
2.1 Rest API - Add Source :
Refer REST API (Link)
2.2 Rest API - Upload Data
Refer REST API (Link)
3: Support for Change data capture(CDC)
Telmai supports incremental loading of changed data across once the data is ingested into the platform for the first time. This ensures that the whole table is not reread and re-analyzed as part of each run. In order to achieve this the table mentioned in the source needs to have a column which tracks changes across rows.
Tables which have audit fields which track the updated timestamp of the record can be leveraged to use the functionality.
Batch upload rest API defined in 3.2 can be leveraged with a few additional parameters to achieve the functionality.
Rest API - Incremental Data Upload
Refer REST API (Link)
Last updated
