Best mechanism to logging the notebook run/metadata and error details

SailajaB
Databricks Partner

Hi,

How we can integrate log analytics with databricks to log notebook run details and code validations.

Thank you

-werners-
Esteemed Contributor III

in your databricks workspace on the azure portal you can link a log analytics account (under 'Diagnostic settings').

Once it is linked you can check what you want to monitor.

SailajaB
Databricks Partner

Thank you.. How we can push our customlogs to log analytics?

jose_gonzalez
Databricks Employee
Databricks Employee

Hi @Sailaja B​ ,

I will recommend to check the following doc https://docs.microsoft.com/en-us/azure/databricks/administration-guide/account-settings/azure-diagno... it will show you how to log analytics on your Azure databricks

Thank you..

Best way to maintain custmlogs in databricks?

-werners-
Esteemed Contributor III

I think you are looking for sending application logs.

I'd use Log4j as this is already used by Databricks.

The link does not use notebooks but it should work in notebooks too.

View solution in original post