Databricks Community

PabloCSD

Hello, I'm currently with a colleague inspecting the code and when trying to deploy the DAB it gets stuck: (.venv) my_user@my_pc my-dab-project % databricks bundle deploy -t=dev -p=my-dab-project-prod Building wheel... Uploading my-dab-project-...

PabloCSD · 10-29-2024

I have a process in DBX/DAB and I am using Service Principal for generating a token for reaching the artifacts feed, for security this token lasts 1 hour.import requests YOUR_AZURE_TENANT_ID = ... YOUR_SERVICE_PRINCIPAL_CLIENT_ID = ... YOUR_SECRET_S...

PabloCSD · 10-14-2024

Hello, I currently have a Service Principal (SP) Client_Id and its associated secret, I generated it directly from my workspace in Databricks, i was following this post: https://github.com/databricks/cli/issues/1722, but I don't know how to generate ...

PabloCSD · 10-14-2024

I have a CI/CD process that after a Pull Request (PR) to main it deploys to staging.It works using a Personal Access Token using Azure Pipelines.From local, deploying using Service Principal works (https://community.databricks.com/t5/administration-a...

PabloCSD · 09-30-2024

Context:Hello, I was using a workflow for a periodic process, with my team we were using a Job Compute, but the libraries were not working (even though we had a PIP_EXTRA_INDEX_URL defined in the Environment Variables of the Cluster, so we now use a ...

PabloCSD

When you re-deploy you job, do you augment the version? (e.g., 4.3.0 -> 4.3.1)I have been through this, when I change a definition in the databricks.yml, for example when changing the bundle name, because it detects as a new workflow.Can you explain ...

PabloCSD

I had a similar issue, I installed a private library and I could not use the cluster in a notebook for any commands.I fixed it cloning the cluster, it was like the cluster was saturated. The error I got was something like this:Failure starting repl. ...

PabloCSD

I'm having this issue too (and also a colleague) in the eastus region: run failed with error message Cluster '1212-135649-a2x5p6jg' was terminated. Reason: BOOTSTRAP_TIMEOUT (SERVICE_FAULT). Parameters: databricks_error_message:Bootstrap Timeout. P...

PabloCSD

I have had this problem many times, today I made a copy of the cluster and it got "de-saturated", it could help someone in the future

PabloCSD · 10-29-2024

Hello @agallard,I tried with the first solution but the workflow tries to install the dependencies used in the second workflow but it didn't work (in the posted .yaml I already have a depends_on).The workflow runs when the user requieres it, that is ...

Databricks Community

User Stats

User Activity

Exhausted Server when deploying a Databricks Assets Bundle (DAB)

Generate a Workflow that Waits for Library Installation

How to generate an Azure Subscription from a Databricks Generated Service Principal?

How to deploy to Databricks Assets Bundle from Azure DevOps using Service Principal?

[DATA_SOURCE_NOT_FOUND] Failed to find data source

Re: "Databricks Bundle Deploy -t prod" command deletes log of historical runs

Re: init_script breaks Notebooks

Re: Bootstrap Timeout during cluster start

Re: Failure starting repl. How to resolve this error? I got this error in a job which is running.

Re: Generate a Workflow that Waits for Library Installation