Databricks Community

I am trying to configure cluster for a pipeline like above, However dlt keeps using the small cluster as usual, how to resolve this? 

I am trying to run a SQL alert task in data bricks job, Service principal is the run_as as set to the job, and task fails with below error message.  I also checked if SPN can be granted permission on SQL alert and SQL query, turns out only user id or...

I am trying to build a dlt pipeline which fetches data from fabric onelake tables and stores it in databricks. To do this, i am using azure service principals and  databricks asset bundles. i have setup authentication configs as per official document...