Hi,

How do I configure my DLT (Delta Live Table pipeline notebook) _delta_logs with my Azure Log Analytics workspace? I'm encountering issues because the pipeline runs on a job cluster, which doesn't allow me to specify the destination of the log files under Advanced Options when creating the cluster.

Additionally, when running the pipeline on the job cluster, I encounter errors with commands like:
dbutils.secrets.get

This function is meant to retrieve secrets and configure logging. How can I ensure that my Log Analytics workspace ID and Primary Key—stored in my Azure Key Vault and saved within a Databricks scope—are correctly configured?

Thank you!