Еmil
New Contributor III

‎12-08-2023 06:08 AM

Hi @Retired_mod,

Thank you for your post, I thought it will solve my issues too, however after reading your suggestion it was nothing new for me, because l already have done exactly that.. Here is what I have dome so you or anyone can replicate it:

1. I used databricks bundle init to create a bundle with default python template 
2. I modified the generated databicks.yaml to have my custom target names a per your post.

When I run databricks bundle deploy -t my_env I have set the Repo main branch for both production an development mode environments. I expect when deploying the code from the main branch repo to be used however I can not get that working...

Here is the error I get:

databricks bundle deploy -t dev_001 --var="shared_autoscaling_cluster_id=****"
Starting upload of bundle files
Error: /Repos/Actuarial/CLUKDataPlatform.Bulkmarker.Notebooks/files does not exist; please create it first

Here is my bundle yaml for the custom target:
targets:
    mode: production
    git:
      branch: main
    default: true
    workspace:
      root_path: /Repos/MyProject/AzDO.Repo.Notebooks

Here is my resource basic notebook yaml:
resources:
  jobs:
    A_basic_inputs:
      name: A_basic_inputs
      deployment_config:
        no_package: true
      git_source:
        git_provider: azureDevOpsServices
        git_branch: main
      tasks:
        - task_key: A_basic_inputs
          notebook_task:
            notebook_path: subfolder/A_basic_inputs.py
            source: WORKSPACE
          existing_cluster_id: ${var.shared_autoscaling_cluster_id}

Please, please can someone tell me what is wrong and how do I configure the yaml to point to the Repo?
Any pointers to working code example or documentation/schema yaml reference is much appreciated.

Thanks!

Emil