Databricks asset bundles deployment to development

naga_databricks — Mon, 09 Oct 2023 12:28:00 GMT

Hi All,

I am using Databricks Asset Bundles to deploy my code on github to databricks workspace. I have written out the Github Action as provided on databricks documentation.

I have setup the personal access token for the service principal I want to use to deploy with a Github Action.

I have can_user & can_manage permisions on this service principal.

I generated a personal access token for a service principal following the steps from https://docs.gcp.databricks.com/dev-tools/service-principals.html

Following which I have setup the Github Action following https://docs.gcp.databricks.com/dev-tools/bundles/ci-cd.html

I have the SP_TOKEN setup on the github secrets for the respective environments.

When I deploy from my local using my user personal access token, I can see the development mode deployment working very well.

However, on using my user personal token or the personal token of service principal from Github Actions, I get following error:

Error: default auth: cannot configure default credentials. Config: host=

Following is the Github Actions:

# This workflow validates, deploys, and runs the specified bundle # within a pre-production target named "qal". name: "DAB - Non Production deployment" # Ensure that only a single job or workflow using the same concurrency group # runs at a time. concurrency: "1" ## Trigger this workflow whenever a pull request is opened against the repo's ## main branch or an existing pull request's head branch is updated. on: workflow_dispatch: inputs: Environment: type: choice description: 'Choose the environment:' required: true options: - dev - qal jobs: deploy: name: "Deploy bundle" runs-on: ubuntu-latest steps: # Check out this repo, so that this workflow can access it. - uses: actions/checkout@v3 # Download the Databricks CLI. # See https://github.com/databricks/setup-cli - uses: databricks/setup-cli@main # Validate the bundle to the selected target as defined # in the bundle's settings file. - run: databricks bundle validate working-directory: . env: DATABRICKS_TOKEN: ${{ secrets.SP_TOKEN }} DATABRICKS_BUNDLE_ENV: ${{github.event.inputs.Environment}} # Deploy the bundle to the selected target as defined # in the bundle's settings file. - run: databricks bundle deploy working-directory: . env: DATABRICKS_TOKEN: ${{ secrets.SP_TOKEN }} DATABRICKS_BUNDLE_ENV: ${{github.event.inputs.Environment}}

Can someone who have setup the Github Actions with DAB help me out

Re: Databricks asset bundles deployment to development

naga_databricks — Tue, 10 Oct 2023 10:01:17 GMT

Finally, i was able to identify the missing piece. This was setting up the environment identifier for the runner.

name: "Deploy bundle" runs-on: ubuntu-latest environment: ${{github.event.inputs.Environment}}

With this, the action was able to get the secrets from the github environment.

The host property for DATABRICKS_HOST is provided via the bundles configurations, it doesnt need to be provided again on the Github action.

topic Databricks asset bundles deployment to development in Data Engineering

Databricks asset bundles deployment to development

Re: Databricks asset bundles deployment to development