https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34535#M25277 <P>Thank you.. How we can push our customlogs to log analytics?</P> Wed, 24 Nov 2021 10:56:23 GMT SailajaB 2021-11-24T10:56:23Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34532#M25274 <P>Hi,</P><P></P><P>How we can integrate log analytics with databricks to log notebook run details and code validations.</P><P></P><P>Thank you</P> Tue, 23 Nov 2021 15:11:47 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34532#M25274 SailajaB 2021-11-23T15:11:47Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34533#M25275 <P>in your databricks workspace on the azure portal you can link a log analytics account (under 'Diagnostic settings').</P><P>Once it is linked you can check what you want to monitor.</P> Tue, 23 Nov 2021 15:55:13 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34533#M25275 -werners- 2021-11-23T15:55:13Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34534#M25276 <P>Hi @Sailaja B​&nbsp;,</P><P></P><P>I will recommend to check the following doc <A href="https://docs.microsoft.com/en-us/azure/databricks/administration-guide/account-settings/azure-diagnostic-logs" target="test_blank">https://docs.microsoft.com/en-us/azure/databricks/administration-guide/account-settings/azure-diagnostic-logs</A> it will show you how to log analytics on your Azure databricks</P> Tue, 23 Nov 2021 23:52:59 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34534#M25276 jose_gonzalez 2021-11-23T23:52:59Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34535#M25277 <P>Thank you.. How we can push our customlogs to log analytics?</P> Wed, 24 Nov 2021 10:56:23 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34535#M25277 SailajaB 2021-11-24T10:56:23Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34536#M25278 <P>Thank you..</P><P></P><P>Best way to maintain custmlogs in databricks?</P><P></P> Wed, 24 Nov 2021 10:57:39 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34536#M25278 SailajaB 2021-11-24T10:57:39Z https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34537#M25279 <P>I think you are looking for <A href="https://docs.microsoft.com/en-us/azure/architecture/databricks-monitoring/application-logs" alt="https://docs.microsoft.com/en-us/azure/architecture/databricks-monitoring/application-logs" target="_blank">sending application logs</A>.</P><P>I'd use Log4j as this is already used by Databricks.</P><P>The link does not use notebooks but it should work in notebooks too.</P> Wed, 24 Nov 2021 11:08:40 GMT https://community.databricks.com/t5/data-engineering/best-mechanism-to-logging-the-notebook-run-metadata-and-error/m-p/34537#M25279 -werners- 2021-11-24T11:08:40Z