topic Re: Deploying Databricks Workflows and Delta Live Table pipelines across workspaces in Data Engineering

Deploying Databricks Workflows and Delta Live Table pipelines across workspaces

Vsleg — Sat, 03 Dec 2022 08:43:58 GMT

Hello,

I was wondering if there is a way to deploy Databricks Workflows and Delta Live Table pipelines across Workspaces (DEV/UAT/PROD) using Azure DevOps.

Re: Deploying Databricks Workflows and Delta Live Table pipelines across workspaces

Hubert-Dudek — Sat, 03 Dec 2022 11:30:47 GMT

Yes, for sure, using Rest API Calls to https://docs.databricks.com/workflows/delta-live-tables/delta-live-tables-api-guide.html

You can create DLT manually from GUI and take JSON representative of it, tweak it (so it uses your env variables, for example) and set it under Azure DevOps.

Re: Deploying Databricks Workflows and Delta Live Table pipelines across workspaces

jose_gonzalez — Wed, 25 Jan 2023 23:39:59 GMT

Thank you @Hubert Dudek for sharing this docs. @Vincent Slegers please let us know if you still need help