cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

where saving the wheel package?

jeremy98
Contributor III

Hi community,

We have deployed the wheel package internally in our bundle repository: 

artifacts:
  rnc_lib:
    type: whl
    build: poetry build
    path: .

# For passing wheel package to workspace
sync:
  include:
    - ./dist/*.whl

The problem is that if we want to install packages in each notebook scope file, for now, we do it one by one:

%pip install sentry-sdk=2.19.0

but, this is not feasible, so which is the best practice in this case? Deploying the wheel in a Workspace/Shared location? Or?

1 REPLY 1

Renu_
New Contributor III

Hi @jeremy98 

You can upload the wheel to a shared workspace location and configure it for cluster-level installation by attaching it as a library.

Or you can also automate the process by adding the wheel to the libraries section of your databricks.yml task configuration.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now