08-30-2022 01:36 AM
I'm using Python Wheel Task in Databricks job with WHEEL dependencies. However, the cluster installed the dependencies as JAR instead of WHEEL. Is this an expected behavior or a bug?
09-01-2022 05:33 AM
Hi @John William it could be a user error while uploading the library. I installed two wheel libraries to my cluster. For one library I used the format as Wheel and for the other I used JAR. In both cases, the library will be installed.
09-01-2022 05:33 AM
09-03-2022 01:59 PM
Hi @John William , We haven't heard from you on the last response from @Prabakar , and I was checking back to see if his suggestions helped you.
Or else, If you have any solution, please share it with the community as it can be helpful to others.
Also, Pleadon'tn't forget to click on t"e "Select As B"st" button whenever the information provided helps resolve your question.
03-06-2024 08:57 AM
There you can see a complete template project with a python wheel task and Databricks Asset Bundles. Please, follow the instructions for deployment.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.