Skip to main content

Home

Delta Tables

Delta tables are supported in Databricks, which can be integrated into Unravel for monitoring. You can configure Unravel to fetch the metadata of the Delta tables and monitor them from the Data page. Data

Configuration workflow

The following diagram illustrates the configuration workflow:

Delta_table_metadata_processing.png

Usually, Unravel fetches table metadata details from hive metastore. However, some fields are missing for Delta tables while fetching metadata over hive metastore. Therefore, you must use the Delta Tables extractor utility, run a job, and fetch the metadata details in a JSON file. You must upload this file to a location on the Unravel node.

After uploading the file, you must run the delta_file_handoff.sh script using the manager utility. You can then monitor Delta lake tables from the Data page.Data

In this section: