topic CICD Unity Catalog in Get Started Discussions

CICD Unity Catalog

tamer — Thu, 12 Sep 2024 08:51:00 GMT

Hello How do you handle deploying Databricks Unity Catalog resources (schemas, tables, views, permissions) across environments? What are the strategies for building (compiling), validating and deploying these resources and ensure they’re error-free and consistent? Are there any existing tools or processes to use for validation ? Then, how to deploy them ? I believe there must be a way to compile, build, validate and deploy the unity catalog objects. Thanks

Re: CICD Unity Catalog

Witold — Thu, 12 Sep 2024 09:18:06 GMT

Databricks Asset Bundles

However, in its early stage in doesn't support many things yet. At the moment you can only define schemas without permissions, volumes will follow in the next versions. Permissions only for jobs/pipelines/models. But there's no concept of deploying other objects yet.

For the time being we cover the not yet supported features with the Databricks Terraform provider.

Re: CICD Unity Catalog

tamer — Fri, 20 Sep 2024 08:55:21 GMT

Thanks, yes DAB can be used, but I'm still wondering how to validate the syntax, dependencies, permissions, etc. before deploying the DAB.

Example: when you deploy an SQL Database DACBAC file, first you need to build the project and generate a DACBAC which you can deploy to test/prod environment