Databricks Community

@Daniel Sahal​ - Noted. Thanks Daniel!

In your ADF Pipeline activity, set two different pipeline activities from the If condition activity based on success or failure (the green and red arrows). Then inside each pipeline activity, you can add a set variable, get variable and your adb note...

Hi @Punit Chauhan​ you can use databricks notebook activity in ADF to trigger you databricks notebook via ADF-

Have you tried do debug the json payload of adf trigger ? maybe it wrongly conveys tables names

You can only append Data with Parquet that's why you need to convert your parquet table to Delta. It will be much easier.

df2.select([column_name]).writeORdf2.select(column_name).write

Hi SailajaB,Try this out.Notebook, once executed successfully return a long JSON formatted output. We need to specify appropriate nodes to fetch the output. In below screenshot we can see that when notebook ran it returns empName & empCity as output....

Hi @Vibhor Sethi​ ,There is a global timeout in Azure Data Factory (ADF) that you can use to stop the pipeline. In addition, you can use the notebook timeout in case you want to control it from your Databricks job.