Cannot update databricks repos in Devops Pipeline

erigaud — Fri, 18 Aug 2023 09:49:48 GMT

Hello,

I am creating a Devops pipeline to run unit tests in my notebooks using the Nutter library. When a commit is pushed to a branch, I have a pipeline that triggers, and it should update my repo in a folder Staging (/Repos/Staging/MyRepo)

For that I have the following pipeline :

- script: |
    databricks repos update --path $(STAGING_DIRECTORY) --branch "my_current_branch"
  env:
    DATABRICKS_HOST: $(databricks_host)
    DATABRICKS_TOKEN: $(databricks_token)
  displayName: 'Update Staging project'

When running, this command fails with the following error :

Error: InvalidSchema: No connection adapters were found for '://None/api/2.0/workspace/get-status'

Do you have an idea of what could cause this error ? I can provide more details if needed.

Thank you

Re: Cannot update databricks repos in Devops Pipeline

User16539034020 — Wed, 30 Aug 2023 19:36:10 GMT

Hello,

Thanks for contacting Databricks Support.

The error message indicates that there is an issue with the URL or endpoint you are using with the Databricks repos update command. It appears that one or more required parameters are not being set correctly, leading to the URL being constructed with missing or incorrect information. Could you please check if the environment variables are provided correctly in your CI pipeline?

Here are a few steps to troubleshoot and resolve this issue:
1. Ensure that the environment variables DATABRICKS_HOST and DATABRICKS_TOKEN are set correctly
2. Use full url including the organization parameter.
3. Confirm that the variables $(STAGING_DIRECTORY) and "my_current_branch" are being correctly substituted with their values. You can add debugging output to display the values of these variables to verify if they contain the expected values.

Regards,
Monica

topic Cannot update databricks repos in Devops Pipeline in Data Engineering

Cannot update databricks repos in Devops Pipeline

Re: Cannot update databricks repos in Devops Pipeline