Hi @pablogarcia ,

You need configure serverless environement to achive that. Refere to below documentation:

Configure the serverless environment | Databricks on AWS

Specifically to those sections:

- Configure the serverless environment | Databricks on AWS

- Configure the serverless environment | Databricks on AWS

Hi,

Hi,

Thanks a lot for the documentation, but we dont configure any job manually in DBX UI everything happens programmatically  using yaml and deploy with DBX Bundle. For serverless I'm using 

      environments:
        - environment_key: serverless_default
          spec:
            environment_version: "4"
            dependencies:
              - pip:
#                  - "extra-index-url=https://almengineering:${var.azure_pat}@pkgs.dev.azure.com/almengineering/_packaging/MLEngineering/p..."
                # - "databricks-mlops-stack==0.2.64"
                  - databricks-feature-engineering==0.12.1
                  - "locust>=2,<3"
                  - "geventhttpclient>=2,<3"
              - whl: "/Volumes/catalog/sanity_build/wheels_volume/databricks_mlops_stack-0.2.63-py3-none-any.whl"

I've tried multiple possible conviction, and with non of them I manage to get the dependency in the serverless. I even create a script to check the dependencies in the serverless when it runs and the dependency is not there.

Hi,

It should work with DAB as well. Look at below thread:

Solved: Python Wheel in Serverless Job in DAB - Databricks Community - 135005

Can you try remove "whl:" from your path?