topic Re: Variables passed from ADF to Databricks Notebook Try-Catch are not accessible in Data Engineering

Variables passed from ADF to Databricks Notebook Try-Catch are not accessible

Abhi0607 — Wed, 17 Apr 2024 14:18:01 GMT

Dear Members,

I need your help in below scenario.

I am passing few parameters from ADF pipeline to Databricks notebook.

If I execute ADF pipeline to run my databricks notebook and use these variables as is in my code (python) then it works fine.

But as soon as I use Try and catch block in my notebook then these variables which are passed from ADF pipeline, it does not recognize these variables. I can still print value of those variables outside the Try-Catch block but not inside Try-Catch.

Can you please suggest how can I proceed or access the variables which are passed by ADF inside the Try-Catch blocks of databricks notebook?

Note: This issue happens only if I run my databricks notebook through ADF pipeline. If I assign values in notebooks and run standalone notebook then it works.

Thank you for your help!

Re: Variables passed from ADF to Databricks Notebook Try-Catch are not accessible

Ajay-Pandey — Wed, 17 Apr 2024 14:18:42 GMT

Hi @Abhi0607

Can you please help me to find if you are taking or defining these parameter value outside try catch or inside it ?

Re: Variables passed from ADF to Databricks Notebook Try-Catch are not accessible

Abhi0607 — Wed, 17 Apr 2024 17:04:50 GMT

Parameters are defined in ADF and transferred to databricks so it is outside try catch