Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I'm using Python Wheel Task in Databricks job with WHEEL dependencies. However, the cluster installed the dependencies as JAR instead of WHEEL. Is this an expected behavior or a bug?
Hi @John Williamโ it could be a user error while uploading the library. I installed two wheel libraries to my cluster. For one library I used the format as Wheel and for the other I used JAR. In both cases, the library will be installed.
Hi @John Williamโ it could be a user error while uploading the library. I installed two wheel libraries to my cluster. For one library I used the format as Wheel and for the other I used JAR. In both cases, the library will be installed.
Project Template for Spark/Databricks with Python packaging and CI/CD automation - andre-salvati/databricks-template
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.