cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks Asset Bundle deploy a job: Python wheel could not be found

PabloCSD
Contributor II

I created a repository for testing DAB, and I'm getting this error:

 

run failed with error message
 Python wheel with name dab_test_repo could not be found. Please check the driver logs for more details

 

This is my databricks.yml:

 

bundle:
  name: dab_test_repo

# Declare to Databricks Assets Bundles that this is a Python project
artifacts:
  default:
    type: whl
    build: poetry build
    path: .

resources:
  jobs:
    dab_test_repo:
      name: dab_test_repo
      tasks:
        - task_key: solve
          job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
          python_wheel_task:
             package_name: dab_test_repo
             entry_point: solver
         #  libraries:
         #    - whl: ./dist/*.whl
        - task_key: forecast
          depends_on:
            - task_key: solve
          job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
          python_wheel_task:
             package_name: dab_test_repo
             entry_point: forecast
          # libraries:
          #   - whl: ./dist/*.whl
        - task_key: regularize
          depends_on:
            - task_key: solve
          job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
          python_wheel_task:
             package_name: dab_test_repo
             entry_point: regularize
          # libraries:
          #   - whl: ./dist/*.whl
        - task_key: persist_data
          depends_on:
            - task_key: forecast
            - task_key: regularize
          job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
          python_wheel_task:
             package_name: dab_test_repo
             entry_point: save_in_database
          # libraries:
          #   - whl: ./dist/*.whl

targets:
  dev:
    mode: development
    default: true
    run_as:
      user_name: my_mail@generic_mail.com
    resources:
      jobs:
        dab_test_repo:
          job_clusters:
            - job_cluster_key: ${bundle.target}-${bundle.name}-job-cluster
              new_cluster:
                num_workers: 2
                spark_version: "13.3.x-cpu-ml-scala2.12"  # Specify the Spark version
                node_type_id: Standard_DS3_v2 # Specify the node type

 

Thanks in advance

 

1 ACCEPTED SOLUTION

Accepted Solutions

PabloCSD
Contributor II

Fixed it:

Uncommenting out:

          # libraries:
          #   - whl: ./dist/*.whl

 

View solution in original post

1 REPLY 1

PabloCSD
Contributor II

Fixed it:

Uncommenting out:

          # libraries:
          #   - whl: ./dist/*.whl

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group