Thank you @MuthuLakshmi for sharing your inputs. Hope I followed it and again got a error -  Failed to resolve references: Task value referenced by 'tasks.DLT.values.pipeline_id' was not found.

I have attached the screenshots of the notebook logic.

Step 1:

DLT_notebook:

In command 3,

                             We are assigning the id to pipeline_id variable and to pass the value in the job task parameter (pipeline_id)

Non_DLT notebook:

      We are getting the value from the DLT notebook passed through task parameter.

Step 2:

In the job configuration setting the parameter to take the value from the DLT notebook.

The job failed with the error below:

When we checked with other people who worked in DLT, they told dbutils.job.taskValues will not work in DLT pipeline.

Could you please help on this and kindly let us know if we I'm missing something.
Thank you in advance.