Thankyou @Retired_mod for the clear explanation. 

I have another set of questions. Please provide your suggestion on these as well.

• I have gone through a tool called "Open Telemetry", which collects the logs, metrics, etc.,. Can this tool be used as an intermediate between Databricks and Splunk?
• Instead of having the Splunk to collect the event data from our application, is there any way to send the application/system logs directly to Databricks?
• Is it possible to send the complete raw data and/or customised filter data from application to Databricks? 

Thankyou!