Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-19-2025 06:01 PM
Hey guys, I have created a custom wheel to hold my common code. Since I cannot install task libraries on a serverless environment, I am installing this library in multiple notebooks using %pip install. What I do is I upload the library to a volume in Unity catalog and then create a copy (symlink) of the wheel file with the following name:
package-0.1.0-py3-none-any.whl. -> package-latest-py3-none-any.whl
package-0.1.0-py3-none-any.whl. -> package-latest-py3-none-any.whl
I do this so that I don't have to update the version in every notebook, every time I make a change. When I install the library in a serverless notebook using
%pip install /Volumes/catalog_name/libs/artifacts/package-latest-py3-none-any.whl, it worked fine. But as soon as I run this notebook as a job, I get this error during the install:
ERROR: Invalid requirement: 'package==latest': Expected end or semicolon (after name and no valid version specifier) package==latest
ERROR: Invalid requirement: 'package==latest': Expected end or semicolon (after name and no valid version specifier) package==latest
I am not able to get past this issue yet. Can anyone suggest the right way to do this?
