Databricks Community

CaptainJack · 08-21-2024

Is it possible to upload files from Databricks to Google Drive? How?

CaptainJack · 07-31-2024

I have workflow like this.1 task: job as a task. Inside this job there is task which is seting parameter x as taskValue using dbutils.jobs.taskValues.set. 2. task dependent on previous job as a task. I would like to access this parameter x. I tried t...

CaptainJack · 07-30-2024

I would like to be able to get custom error's message ideally visible from Workflows > Jobs UI.1. For example, workflow failed because file was missing and could not find it, in this case I am getting "Status" Failed and "Error Code" RunExecutionErro...

CaptainJack · 06-07-2024

I noticed that there is can_manage_run permission on workflow level, and someone can run a workflow only with these permission (without needing can_run permission on notebook level). Problem is that coworker can go to run details and then click on ta...

CaptainJack · 02-23-2024

Hi all. I have workflow which I would like to trigger when new file arrive. Problem is that in my storage account, there are few different types of files. Lets assume that I have big csv file and small xlsx mapping file. I would like to trigger job, ...

CaptainJack · 08-01-2024

I tried this approach and it only works when I am passing value from normal notebook task to another task / job. But when I have "job as task" as source, then it is not working. Maybe I am missing something.I did experiment with 2 tasks passing param...

CaptainJack · 07-31-2024

Any idea for workaround? I thought about tagValue / jobValue as error but I am not sure if it is possible to get these using jobs/runs/get API. If it is really not possible, I am thinking about email notifications as last resort.

CaptainJack · 02-23-2024

Thank you very much. Thats what I needed. Just to clarify auto loader further. I do not need running cluster to make autoloader works, right? Having it set up and in active state wont charge me until file finally arrive i.e. it is still good option w...

CaptainJack · 11-08-2023

I am using this as api = /api/2.0/workspace/import

Databricks Community

User Stats

User Activity

Upload files from Databricks to Google Drive

Get taskValue from job as task, and then pass it to next task.

Error Handling and Custom Messages in Workflows

Giving coworker "runing" permision on workflow but without allowing him access to notebooks.

File arrival trigger customization

Re: Get taskValue from job as task, and then pass it to next task.

Re: Error Handling and Custom Messages in Workflows

Re: File arrival trigger customization

Re: Workspace API