https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26222#M18330 And if it is generic logs which gets landed on S3 , it'd be worth taking a look at Autoloader. Here is a blog post on processing crowdstrike logs in a similar way Mon, 07 Jun 2021 14:14:00 GMT sajith_appukutt 2021-06-07T14:14:00Z https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26220#M18328 <P>We dump our logs in S3 currently. Can you give us best practices to make these logs easier to query?</P><P></P> Fri, 04 Jun 2021 19:48:09 GMT https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26220#M18328 Anonymous 2021-06-04T19:48:09Z https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26221#M18329 If you mean Databricks Audit Logs, you can see example code for easy querying/integration here!<BR /><A href="https://docs.databricks.com/administration-guide/account-settings/audit-logs.html#analyze-audit-logs" target="test_blank">https://docs.databricks.com/administration-guide/account-settings/audit-logs.html#analyze-audit-logs</A> Mon, 07 Jun 2021 14:07:00 GMT https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26221#M18329 User16783855117 2021-06-07T14:07:00Z https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26222#M18330 And if it is generic logs which gets landed on S3 , it'd be worth taking a look at Autoloader. Here is a blog post on processing crowdstrike logs in a similar way Mon, 07 Jun 2021 14:14:00 GMT https://community.databricks.com/t5/data-engineering/best-practices-to-query-logs/m-p/26222#M18330 sajith_appukutt 2021-06-07T14:14:00Z