Best practices to query logs

[Anonymous]

We dump our logs in S3 currently. Can you give us best practices to make these logs easier to query?

[User16783855117 · Accepted solution]

If you mean Databricks Audit Logs, you can see example code for easy querying/integration here!
https://docs.databricks.com/administration-guide/account-settings/audit-logs.html#analyze-audit-logs

[sajith_appukutt]

And if it is generic logs which gets landed on S3 , it'd be worth taking a look at Autoloader. Here is a blog post on processing crowdstrike logs in a similar way