Data Sources

Databricks

Databricks

Overview

This guide explains how to connect Databricks to Connetra. Once configured, Connetra can discover Databricks, tables, jobs, and dashboards.

Step 1: Create an asset token

In your Databricks workspace:

Steps:

  • Go to User Settings
  • Generate a new Access Token
  • Save the token, you’ll use it during setup in Connetra

For query history and popularity metrics, the token should have admin-level access.

Step 2: Grant required permissions

SQL Warehouse Permissions

For each SQL warehouse Connetra will use :

  • Grant Can monitor permission
    This allows Connetra to access warehouse-level query history.
    “Can use” does not provide query history access, and “Can view” is insufficient.

Catalog & Schema Permissions (Unity Catalog)

For each catalog and schema you want Connetra to index, grant:

  • USE_CATALOG
  • USE_SCHEMA
  • BROWSE
  • SELECT

These permissions allow Connetra to discover tables, columns, and metadata.

Step 3: Connect Databricks to Connetra

In Connetra:

  • Go to Settings → Data Connectors → Add Data Connector
  • Select Databricks
  • Enter the following details:
    • Workspace Host
      Your Databricks workspace URL
      Example: dbc-xxxx.cloud.databricks.com
    • Access Token
      The token you created earlier
    • Warehouse ID
      This is where Connetra will run metadata and lineage queries.
      For best performance, use a serverless SQL warehouse
  • To ingest table and column-level lineage via Unity Catalog, a Warehouse ID is required.
  • Click Test Connection

Once successful, submit to start the initial sync