Specify extras of library in asset bundles yml file
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2023 02:01 AM
Hello,
I am using asset bundles to build, deploy, create a cluster and install a package in it. The package comes with some extra dependencies that I also want to include in the cluster. Do you know how to specify this extras in the databricks.yml file? Right now I have this:
resources:
jobs:
train:
name: train-ml
tasks:
- task_key: train-ml
existing_cluster_id: ****
spark_python_task:
python_file: "pipelines/train.py"
libraries:
- whl: ./dist/*.whl
