topic Re: Databricks Audit Logs, What is "dataSourceId"? in Data Engineering

Databricks Audit Logs, What is "dataSourceId"?

Mado — Wed, 22 Feb 2023 23:02:38 GMT

Hi,

I want to access the Databricks Audit Logs to check user activity.

I created a Databricks workspace on the premium pricing tier.

I configured Audit logs to be sent to Azure Diagnostic log delivery. What I got in the "Log Analytics Workspace":

I have two questions.

A) What is the difference between "DatabricksSQL" & "DatabricksDatabricksSQL"?

B) When I open "DatabricksSQL" or "DatabricksDatabricksSQL", and select "executeFastQuery" & "executeAdhocQuery" for ActionName:

I get "dataSourceId" in the column "Requestparams".

I was wondering what "dataSourceId" is. Is it the TableID or CatalogID?

Re: Databricks Audit Logs, What is "dataSourceId"?

Anonymous — Thu, 23 Feb 2023 00:40:06 GMT

ID of the data source for this endpoint. This is used to bind an Databricks SQL query to an endpoint. data_source_id is an another identifier of the SQL Endpoint.

https://docs.databricks.com/administration-guide/account-settings/audit-logs.html#workspace-level-audit-log-events.

Re: Databricks Audit Logs, What is "dataSourceId"?

Mado — Thu, 23 Feb 2023 00:49:49 GMT

Thanks.

Is SQL endpoint the same as SQL Warehouse?

The SQL warehouse ID is different from dataSourceId.

Cluster-ID is also different:

Do you know the difference between "DatabricksSQL" and "DatabricksDatabricksSQL"? Seems that they contain the same information.

Re: Databricks Audit Logs, What is "dataSourceId"?

youssefmrini — Thu, 23 Feb 2023 09:39:10 GMT

The data_source_id field specifies the id of the SQL warehouse against which this query will run. You can use the Data Sources API to see a complete list of available SQL warehouses.

Re: Databricks Audit Logs, What is "dataSourceId"?

Mado — Thu, 23 Feb 2023 10:38:08 GMT

Thanks. But, the id of the SQL warehouse is different from data_source_id as I uploaded in my previous post.