topic Re: Interactive EDA task in a Job Workflow in Machine Learning

Interactive EDA task in a Job Workflow

cmd0160 — Sat, 15 Mar 2025 02:51:12 GMT

I am trying to configure an interactive EDA task as part of a job workflow. I'd like to be able to trigger a workflow, perform some basic analysis then proceed to a subsequent task. I haven't had any success freezing execution. Also, the job workflow UI doesn't look to have the same interactive capabilities as standard notebook UI.

Is it possible to freeze job execution while you do some eda tasks in a job workflow execution?

Re: Interactive EDA task in a Job Workflow

Alberto_Umana — Sat, 15 Mar 2025 17:22:29 GMT

Hello @cmd0160,

Freezing job execution to perform interactive tasks directly within a job workflow is not natively supported in Databricks. The job workflow UI and the notebook UI serve different purposes, and the interactive capabilities you find in the notebook UI are not available in the job workflow UI... Could you elaborate more on what are you trying to achieve?