What are the best practices for python logging function in databricks?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-29-2024 02:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-29-2024 03:33 AM
Hi @hpant ,
I think they are really similiar to overall best practices when in comes to python logging, like having centralize logging configuration, using correct log levels etc.
Look for example on below article:
10 Best Practices for Logging in Python | Better Stack Community
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-29-2024 08:25 AM
Hi @szymon_dybczak,
Thanks for your reply. I wanted to ask if databricks has something similar to Azure Synapse to store the logs, e.g. log Analytics?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-29-2024 08:34 AM
Hi @hpant ,
You can configure diagnostic settings and send the logs to log analytics or storage accounts. Refer to below documentation:
- Send Databricks app logs to Azure Monitor - Azure Architecture Center | Microsoft Learn