cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Cannot update databricks repos in Devops Pipeline

erigaud
Honored Contributor

Hello,

I am creating a Devops pipeline to run unit tests in my notebooks using the Nutter library. When a commit is pushed to a branch, I have a pipeline that triggers, and it should update my repo in a folder Staging (/Repos/Staging/MyRepo)

For that I have the following pipeline : 

script: |
    databricks repos update --path $(STAGING_DIRECTORY) --branch "my_current_branch"
  env:
    DATABRICKS_HOST$(databricks_host)
    DATABRICKS_TOKEN$(databricks_token)
  displayName'Update Staging project'

When running, this command fails with the following error : 

Error: InvalidSchema: No connection adapters were found for '://None/api/2.0/workspace/get-status'

Do you have an idea of what could cause this error ? I can provide more details if needed.

Thank you 

1 REPLY 1

User16539034020
Databricks Employee
Databricks Employee

Hello, 

Thanks for contacting Databricks Support.

The error message indicates that there is an issue with the URL or endpoint you are using with the Databricks repos update command. It appears that one or more required parameters are not being set correctly, leading to the URL being constructed with missing or incorrect information. Could you please check if the environment variables are provided correctly in your CI pipeline?

Here are a few steps to troubleshoot and resolve this issue:
1. Ensure that the environment variables DATABRICKS_HOST and DATABRICKS_TOKEN are set correctly
2. Use full url including the organization parameter.
3. Confirm that the variables $(STAGING_DIRECTORY) and "my_current_branch" are being correctly substituted with their values. You can add debugging output to display the values of these variables to verify if they contain the expected values.

Regards,
Monica

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group