PabloCSD
Valued Contributor II

Hello @ipreston,

In my team right now we are using Databrick Asset Bundle (DAB) and for solving a similar issue which is: retrieving private libraries hosted in Azure DevOps Artifact Feed, we added:

To the databricks.yml:

 

targets:
  dev:
    mode: development
    default: true
    run_as:
      user_name: oishiiramen@chuushoku.com
    resources:
      jobs:
        our_job:
          job_clusters:
            - job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
              new_cluster:
                num_workers: 2
                spark_version: "14.3.x-cpu-ml-scala2.12"
                node_type_id: Standard_F8
                spark_env_vars:
                  PIP_EXTRA_INDEX_URL: "{{secrets/our_secret/our_url}}"

 

To the pyproject.toml:

 

[[tool.poetry.source]]
name = "our_enterprise"
url = "https://our_enterprise.pkgs.visualstudio.com/_packaging/our_enterprise/pypi/simple"
priority = "supplemental"

 

With that I can retrieve the libraries from the artifact feed.