topic Databricks Devops Release Pipeline Abort in Data Engineering

Databricks Devops Release Pipeline Abort

Jonas89 — Wed, 05 Apr 2023 21:56:20 GMT

We've built a release pipeline to our Databricks Workspaces, using the VNET Template. It's working end-to-end but intermittent aborts are occurring when workspace is recreated.

For example, 4th of April (Monday) We recreated the workspaces and no abort happened.

The script is straightforward, check if it's required to recreate the workspace, if required, delete databricks workpace, vnet and network security groups. Once finished start to execute the workspace deploy, based in the VNET template.

This first part always runs fine, without aborts, the problem is the next step, when we try to sync our Notebook Repository with Databricks Repo. On Monday, or Tuesday it worked perfectly, syncing it without problem. On Wednesday it failed:

Maybe it could be a sync problem, the error message suggest that invalid credentials were used, with an error code = "INVALID_STATE". The interesting is that the repo is created partially after this error, and in a 2nd attempt it works without problems:

Any help is appreciate. Thank you

Re: Databricks Devops Release Pipeline Abort

Anonymous — Wed, 12 Apr 2023 07:47:36 GMT

Hi @Jonas Oliveira de Souza

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance!

Re: Databricks Devops Release Pipeline Abort

Debayan — Mon, 10 Apr 2023 05:40:17 GMT

Hi, the issue can be https://learn.microsoft.com/en-us/azure/container-registry/container-registry-troubleshoot-login