We are running multiple Databricks job via ADF. I was wondering which option out of the below is a cheaper route for databricks notebook processing from ADF. When I create a ADF linked service, which should I use to lower my cost.

1. New Job Cluster option
2. Existing instance pool.

Note: I am assuming interactive cluster is out of option as this is definitely more expensive.

Thanks,

Matt