Best mechanism to logging the notebook run/metadata and error details

[SailajaB]

Hi,

How we can integrate log analytics with databricks to log notebook run details and code validations.

Thank you

[-werners-]

in your databricks workspace on the azure portal you can link a log analytics account (under 'Diagnostic settings').

Once it is linked you can check what you want to monitor.

[SailajaB]

Thank you.. How we can push our customlogs to log analytics?

[jose_gonzalez]

Hi @Sailaja B​ ,

I will recommend to check the following doc https://docs.microsoft.com/en-us/azure/databricks/administration-guide/account-settings/azure-diagno... it will show you how to log analytics on your Azure databricks

[SailajaB]

Thank you..

Best way to maintain custmlogs in databricks?

[-werners- · Accepted solution]

I think you are looking for sending application logs.

I'd use Log4j as this is already used by Databricks.

The link does not use notebooks but it should work in notebooks too.