In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?

matkap — Wed, 03 May 2023 23:10:23 GMT

I have successfully used the VSCode extension for Databricks to run a notebook on a cluster from my IDE. However in order to test effectively without changing the source, I need a way to pass parameters to the workflow job.

I have tried various ways of indicating notebook_params in the launch.json (see an example below) but none have successfully been received in the run as shown in the Job Run's Task run details.

Is there a way to pass parameters (to be read via dbutil.widgets) in the VSCode Databricks extension?

{

// Use IntelliSense to learn about possible attributes.

// Hover to view descriptions of existing attributes.

// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387

"version": "0.2.0",

"configurations": [

{

"type": "databricks-workflow",

"request": "launch",

"name": "Run on Databricks as a Workflow",

"program": "${file}",

"parameters": {"name": "John Doe"},

"args": []

]

}

Re: In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?

AsphaltDataRide — Fri, 16 Jun 2023 14:34:01 GMT

Is there a solution for this?

Re: In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?

AsphaltDataRide — Mon, 19 Jun 2023 10:58:34 GMT

@matthew kaplan I am not using widgets but what works is running it by pressing F5 in the python file you want to run.

topic In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job? in Data Engineering

In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?

Re: In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?

Re: In the VSCode Databricks Extension how can one specify notebook parameters to a pass to a workflow job?