I am using the Python SDK and to authenticate I am using a SP and a Secret. Here is the code that worked for me in Azure Databricks notebook.

from databricks.sdk import AccountClient

acct_client = AccountClient(
    host="https://accounts.azuredatabricks.net", 
    account_id=<account_id>, 
    azure_tenant_id=<tenant_id>, 
    azure_client_id=<client_id>, 
    azure_client_secret=<client_secret>
)

for g in acct_client.groups.list():
    print(g)

References:

• https://databricks-sdk-py.readthedocs.io/en/latest/authentication.html#databricks-native-authenticat...
• https://learn.microsoft.com/en-us/azure/databricks/dev-tools/auth/azure-sp
• https://learn.microsoft.com/en-us/azure/databricks/dev-tools/auth/