by
jpwp
• New Contributor III
- 24978 Views
- 9 replies
- 9 kudos
Can someone provide me an example for a python_wheel_task and what the entry_point field should be?The jobs UI help popup says this about "entry_point":"Function to call when starting the wheel, for example: main. If the entry point does not exist in...
- 24978 Views
- 9 replies
- 9 kudos
Latest Reply
Just want to confirm - my project uses PDM not poetryand as such uses[project.entry-points.packages]Rather than[tool.poetry.scripts]and the bundle is failing to run on the cluster - as it can't find the entry point - is this expected behavior?
8 More Replies
- 1689 Views
- 0 replies
- 0 kudos
Hi,I'm working on Azure Databricks and I created two jobs, one based on a python wheel and the other based on a notebook, with the same code. The code get data from Azure blob storage, process data with pyspark and send data to EventHub. The whole co...
- 1689 Views
- 0 replies
- 0 kudos
by
ACK
• New Contributor II
- 3648 Views
- 2 replies
- 2 kudos
Hi,I have a method named main it takes **kwargs as a parameter. def main(**kwargs):
parameterOne = kwargs["param-one"]
parameterTwo = kwargs["param-two"]
parameterThree = kwargs["param-optional-one"] if "param-optional-one" in kwargs else...
- 3648 Views
- 2 replies
- 2 kudos
Latest Reply
it is command-line parameters so it is like ---param-one=testyou can test it with ArgumentParserfrom argparse import ArgumentParser
parser = ArgumentParser()
parser.add_argument("--param-one", dest="parameterOne")
args = parser.parse_args()
1 More Replies
by
jpwp
• New Contributor III
- 5446 Views
- 0 replies
- 0 kudos
Why does adding a dependent library to a Job task also permanently add it to the entire cluster?I am using python wheels, and even when I remove the dependent library from a Job task, the wheel is still part of the cluster configuration.If I then upd...
- 5446 Views
- 0 replies
- 0 kudos
