How to refer the ".whl" files from repos into a Databricks "python wheel" task in Databricks jobs?

[Maverick1]

I was trying to see whether it would be possible to refer a library from a Repos path (as “files in repos” feature is already available).

I can see the “.whl” file in the repo itself but it is not visible under the “Workspace” option of “python wheel” task in the DB jobs.

PFB the snaps:

“.whl” file is visible in Repo:

 

“.whl” file not available for installation while defining the library path for wheel file in DB jobs task.

 

[hotrabattecom]

I also have the same problem as you right now. I try to discover it but I dont know where to find it. Btw here is my site for shopping, https://hotrabatte.com/ .If you want, figure it out.

[Mr__E]

We set up a GitHub workflow to upload the built python wheels to a shared S3 cluster, which is accessible from the workspaces page, then we can add using the dialogue you show. However, I'm having an issue using it for job clusters, so YMMV.

[Maverick1]

@Erik Louie​ : S3 and DBFS path are anyway accessible for job and all-purpose cluster. The query is that there is a "WORKSPACE" option available but still you can't access a library placed on workspace/repos path.

[Maverick1 · Accepted solution]

As of now, The only resolutions for this query are:

1. Either push/deploy the library to an DBFS or S3 path.
2. Either deploy the library on a repos path and then refer it inside a notebook via passing repos path.

Accessing Workspace path or root "file:/" path is not possible.