Hi, I'm using the Databricks asset bundle to deploy my job to Azure Databricks.
I want to configure the Databricks bundle so that when anyone runs the Azure pipeline, a job is created under their name in the format dev_username_job.
Using a personal access token(DATABRICKS_TOKEN), the deployment always occurs under the user associated with the token passed as an environment variable.
Using DATABRICKS_CLIENT_ID and DATABRICKS_CLIENT_SECRET, the deployment occurs under the service principal dev_service_principal_ID.
Here is my snippet from the databricks.yml file:
targets:
dev:
default: true
mode: development
workspace:
host: host_url
prod:
mode: production
workspace:
host: host-url
run_as:
service_principal_name: service-principal-ID
I also have an azure-pipeline.yml file where I deploy my job to Databricks: - bash: |
databricks bundle deploy -t dev
env:
DATABRICKS_HOST: $(DEV_DATABRICKS_HOST)
DATABRICKS_CLIENT_ID: $(DATABRICKS_CLIENT_ID)
DATABRICKS_CLIENT_SECRET: $(DATABRICKS_CLIENT_SECRET)
Can anyone please help me on this?
