Databricks Community

CaptainJack

1. How could I pull workspace url (https://adb-XXXXX.XX.....net) 2. How could I get workspace name visible in top right corner.I know that easies solution is dbutils.notebook.entry_point.... browserHostName but unfortunetly it is not working in job c...

CaptainJack · 08-21-2024

Is it possible to upload files from Databricks to Google Drive? How?

CaptainJack · 07-31-2024

I have workflow like this.1 task: job as a task. Inside this job there is task which is seting parameter x as taskValue using dbutils.jobs.taskValues.set. 2. task dependent on previous job as a task. I would like to access this parameter x. I tried t...

CaptainJack · 07-30-2024

I would like to be able to get custom error's message ideally visible from Workflows > Jobs UI.1. For example, workflow failed because file was missing and could not find it, in this case I am getting "Status" Failed and "Error Code" RunExecutionErro...

CaptainJack · 06-07-2024

I noticed that there is can_manage_run permission on workflow level, and someone can run a workflow only with these permission (without needing can_run permission on notebook level). Problem is that coworker can go to run details and then click on ta...

CaptainJack

Did someone was able to get pipeline_id programaticaly?

CaptainJack · 08-01-2024

I tried this approach and it only works when I am passing value from normal notebook task to another task / job. But when I have "job as task" as source, then it is not working. Maybe I am missing something.I did experiment with 2 tasks passing param...

CaptainJack · 07-31-2024

Any idea for workaround? I thought about tagValue / jobValue as error but I am not sure if it is possible to get these using jobs/runs/get API. If it is really not possible, I am thinking about email notifications as last resort.

CaptainJack · 02-23-2024

Thank you very much. Thats what I needed. Just to clarify auto loader further. I do not need running cluster to make autoloader works, right? Having it set up and in active state wont charge me until file finally arrive i.e. it is still good option w...

CaptainJack · 11-08-2023

I am using this as api = /api/2.0/workspace/import

Databricks Community

User Stats

User Activity

Pull workspace url and workspace name using databricks-sdk / programaticaly in notebook

Upload files from Databricks to Google Drive

Get taskValue from job as task, and then pass it to next task.

Error Handling and Custom Messages in Workflows

Giving coworker "runing" permision on workflow but without allowing him access to notebooks.

Re: How to capture dlt pipeline id / name using dynamic value reference

Re: Get taskValue from job as task, and then pass it to next task.

Re: Error Handling and Custom Messages in Workflows

Re: File arrival trigger customization

Re: Workspace API