by
jpwp
• New Contributor III
- 25067 Views
- 9 replies
- 9 kudos
Can someone provide me an example for a python_wheel_task and what the entry_point field should be?The jobs UI help popup says this about "entry_point":"Function to call when starting the wheel, for example: main. If the entry point does not exist in...
- 25067 Views
- 9 replies
- 9 kudos
Latest Reply
Just want to confirm - my project uses PDM not poetryand as such uses[project.entry-points.packages]Rather than[tool.poetry.scripts]and the bundle is failing to run on the cluster - as it can't find the entry point - is this expected behavior?
8 More Replies
- 2700 Views
- 2 replies
- 1 kudos
I'm using Python Wheel Task in Databricks job with WHEEL dependencies. However, the cluster installed the dependencies as JAR instead of WHEEL. Is this an expected behavior or a bug?
- 2700 Views
- 2 replies
- 1 kudos
Latest Reply
There you can see a complete template project with a python wheel task and Databricks Asset Bundles. Please, follow the instructions for deployment.https://github.com/andre-salvati/databricks-template
1 More Replies
by
GGG_P
• New Contributor III
- 6394 Views
- 3 replies
- 0 kudos
I'm using Python (as Python wheel application) on Databricks.I deploy & run my jobs using dbx.I defined some Databricks Workflow using Python wheel tasks.Everything is working fine, but I'm having issue to extract "databricks_job_id" & "databricks_ru...
- 6394 Views
- 3 replies
- 0 kudos
Latest Reply
There you can see a complete template project with Databricks Asset Bundles and python wheel task. Please, follow the instructions for deployment.https://github.com/andre-salvati/databricks-templateIn particular, take a look at the workflow definitio...
2 More Replies
- 3240 Views
- 0 replies
- 1 kudos
I want to trigger Databricks job from Airflow using DatabricksSubmitRunDeferrableOperator and I need to pass configuration params. Here is excerpt from my code (definition is not complete, only crucial properties):from airflow.providers.databricks.op...
- 3240 Views
- 0 replies
- 1 kudos
by
jpwp
• New Contributor III
- 5461 Views
- 0 replies
- 0 kudos
Why does adding a dependent library to a Job task also permanently add it to the entire cluster?I am using python wheels, and even when I remove the dependent library from a Job task, the wheel is still part of the cluster configuration.If I then upd...
- 5461 Views
- 0 replies
- 0 kudos
