Databricks Community

jeremy98

Hi guys, Which is the way through Databricks Asset Bundle to declare a new job definition having a serveless compute associated on each task that composes the workflow and be able that inside each notebook task definition is possible to catch the dep...

jeremy98

Hello community,I want to have a new token, to be available to our users to interact with staging workspace. Is it possible to generate a token to be used for triggering only workflow in staging workspace databricks with databricks api?

jeremy98

Hi community,I was wondering after passing a list of dict through tasks using .taskValue.set() method, how to maintain the same data type through each task?Because seems, that when I use the for loop and getting by the parameters each element of the ...

jeremy98

Hi community,I was running a workflow based on different tasks but also taking into account the existed cluster to execute those tasks, but I was getting error in configurations: run failed with error message Library installation failed for library d...

jeremy98

Hello community,Is it possible to get metadata workflow of a databricks job that is running? Like the start time, end time, triggered by etc.? Using dbutils.widgets.get()?

jeremy98

Hello,I would like to revisit this topic as I now have a clearer understanding of my needs and the issue at hand.Let’s assume we have only one active Databricks workspace, which currently serves as both development and production. This dual role adds...

jeremy98

Hello @Alberto_Umana , news?

jeremy98

Hello, tasks: - task_key: batch_inference description: "Trigger batch inference processing" spark_python_task: python_file: "../py_scripts/infge.py" # Path to your Python script parameters: ...

jeremy98

@Alberto_Umana, one of my colleague did it using a spark_python_task... maybe this is something only for certain types of files?

jeremy98

Good morning,Thanks for the answer, yes please let me know because I found the solution to declare it in the higher level but seems still that doesn't catch the environment inside each task, but If I look the task structure there, there is the enviro...

Databricks Community

User Stats

User Activity

wheel package to install in a serveless workflow

token share

For each task field

Problem with installing Python WHEEL in an existed cluster

Catch Metadata Workflow databricks

Re: How to deploy unique workflows that running on production

Re: wheel package to install in a serveless workflow

Re: wheel package to install in a serveless workflow

Re: wheel package to install in a serveless workflow

Re: wheel package to install in a serveless workflow