Databricks notebook command logging

[C_1]

Hello Community,

I am trying to search for Databricks notebook command logging feature for compliance purpose.

My requirement is to log the exact spark sql fired by user.

I didnt get spark sql (notebook command) tracked under this azure diagnostic logs.

https://docs.microsoft.com/en-us/azure/databricks/administration-guide/account-settings/azure-diagno...

Any help will be appreciated?

[Kaniz]

Hi @C P​ ,  

Note : -

Diagnostic logs require the Azure Databricks Premium Plan.

[C_1]

Hi @Kaniz Fatma​ ,

yes we are having premium plan.

could you please confirm if spark SQL query fired by user get track under Diagnostic logs or getting track somewhere else?

[Noopur_Nigam · Accepted solution]

Hi @C P​ we don't have this feature implemented, however, there is already an existing idea available in our idea portal here: https://databricks.aha.io/features/DB-7583.

You can check and vote the same.

[C_1]

Hi @Noopur Nigam​ ,

i am not able to login to above databricks.aha portal.

could you pls allow me to login or paste the idea here?

thanks for replying!!

[Kaniz]

Hi @C P​ , Can you please share all the relevant details and information on community@databricks.com so that I can escalate the issue?

[jose_gonzalez]

Hi @C P​,

Just a friendly follow-up. Did you miss Kaniz's response?

[jose_gonzalez]

HI @C P​,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.