Best practices to query logs

Anonymous
Not applicable

‎06-04-2021 12:48 PM

We dump our logs in S3 currently. Can you give us best practices to make these logs easier to query?

0 Kudos

User16783855117
Databricks Employee
Databricks Employee

‎06-07-2021 07:07 AM

If you mean Databricks Audit Logs, you can see example code for easy querying/integration here!
https://docs.databricks.com/administration-guide/account-settings/audit-logs.html#analyze-audit-logs

View solution in original post

0 Kudos

sajith_appukutt
Databricks Employee
Databricks Employee

‎06-07-2021 07:14 AM

And if it is generic logs which gets landed on S3 , it'd be worth taking a look at Autoloader. Here is a blog post on processing crowdstrike logs in a similar way
0 Kudos