- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-22-2024 01:25 AM
Hi all. I am no longer able to install my custom wheel in my DLT pipeline. No matter what configuration I try I cannot get it to work: parameterized or just hard-coding the path to the wheel. If I run the hard-coded cell with an all-purpose cluster the wheel installs just fine, so I am guessing DLT has not longer access to my workspace files?
I have deployed the pipeline via a Databricks Asset Bundle and I am trying to load from a /Workspace/Shared/ folder. The error message I am getting is always the same:
CalledProcessError: Command 'pip --disable-pip-version-check install Workspace/Shared/.bundle/blifc/acc/files/dist/blifc-*-py3-none-any.whl' returned non-zero exit status 1.
See the attached screenshots for a bunch of things I tried, and the error message.
- Labels:
-
DABs
-
DLT
-
Python Wheel
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-22-2024 07:11 AM
I managed to fix the issue. The problem was that my wheel was built for Databricks Runtime 14.3 LTS and I was using the PREVIEW channel rather than the CURRENT channel. At time of writing:
- CURRENT(default): Databricks Runtime 14.1 --> Python: 3.10.12
- PREVIEW: Databricks Runtime 15.2 --> Python: 3.11.0
I am not very happy about the generic error message, so hopefully Databricks will fix that in the future.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-22-2024 07:11 AM
I managed to fix the issue. The problem was that my wheel was built for Databricks Runtime 14.3 LTS and I was using the PREVIEW channel rather than the CURRENT channel. At time of writing:
- CURRENT(default): Databricks Runtime 14.1 --> Python: 3.10.12
- PREVIEW: Databricks Runtime 15.2 --> Python: 3.11.0
I am not very happy about the generic error message, so hopefully Databricks will fix that in the future.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-30-2024 12:36 AM
@Thms317 ,Thanks for sharing
Bhanu Gautam
Kudos are appreciated
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)