Connect GX Cloud to Databricks SQL

Prerequisites

• You have a GX Cloud account with Admin or Editor permissions.

• You have a Databricks SQL catalog, schema, and table.

• Optional. To improve data security, GX recommends creating a separate Databricks SQL service principal for your GX Cloud connection.

Connect to a Databricks SQL Data Source and add a Data Asset

1. In GX Cloud, click Data Assets > New Data Asset > New Data Source > Databricks SQL.

2. Enter a meaningful name for the Data Source in the Data Source name field.

3. Enter a connection string in the Connection string field. The connection string format is:

   Databricks SQL connection string

   databricks://token:{token}@{host}:{port}?http_path={http_path}&catalog={catalog}&schema={schema}

   If you created a separate Databricks SQL service principal for your GX Cloud connection as recommended above, use those credentials in the connection string.

4. Click Connect.

5. Select one or more tables to import as Data Assets.

6. Click Add x Asset(s).

7. Decide which common data quality issues you want to start monitoring. By default, GX Cloud adds Expectations to detect Schema, Volume, and Completeness issues. You can de-select recommendations you’d like to opt out of.

8. Click Start monitoring or Finish.

Next steps

• Add an Expectation.
• Run a Validation.