Databricks Community

ganesh_raskar · 01-02-2026

I have a custom Python package that provides a PySpark DataSource implementation. I'm using Databricks Connect (16.4.10) and need to understand package installation options for serverless compute.Works: Traditional Compute ClusterCustom package pre-i...

ganesh_raskar · 01-04-2026

@Sanjeeb2024 It works perfectly fine in notebook by either installing !pip install or pre-install on serverless environment that notebook is attached to. It just that with spark connect with serverless compute, I don't see an option to install it. I ...

ganesh_raskar · 01-03-2026

Hi @Hubert-Dudek ,Thank you for your comment. I did try this as well, but no luck. Uploaded the wheel package in the volume (read access to all users), lets say at this path:/Volumes/main/my@my.com/test/dice-4.0.0-py3-none-any.whl ```pythonvolumes_de...

Databricks Community

User Stats

User Activity

Installing Custom Packages on Serverless Compute via Databricks Connect

Re: Installing Custom Packages on Serverless Compute via Databricks Connect

Re: Installing Custom Packages on Serverless Compute via Databricks Connect