Does Databricks integrate with Splunk? What are some ways to send metrics/logs to Splunk

aladda — Mon, 21 Jun 2021 20:05:23 GMT

Re: Does Databricks integrate with Splunk? What are some ways to send metrics/logs to Splunk

aladda — Mon, 21 Jun 2021 20:05:50 GMT

The Databricks Add-on for Splunk built as part of Databricks Labs can be leveraged for Splunk integration

It’s a bi-directional framework that allows for in-place querying of data in databricks from within Splunk by running queries, notebooks or jobs so you don’t have to move the data and still have access to it from within. Docs are here - https://github.com/databrickslabs/splunk-integration#Documentation
It can also push data to Splunk via its HEC (Http Event Collector) - https://github.com/databrickslabs/splunk-integration/blob/master/docs/markdown/Databricks%20-%20Push%20to%20Splunk.md