In your .env file, add:

  DATABRICKS_WORKSPACE_RESOURCE_ID=/subscriptions/your-sub-id/resourceGroups/your-rg/providers/Microsoft.Databricks/workspaces/your

  -workspace

  Alternative approaches if the popup persists:

  1. Use OAuth machine-to-machine (M2M) authentication (recommended for newer workspaces):

  auth_type="databricks-oauth"

  2. Ensure your service principal has proper permissions:

    - The SP needs to be added as a user in your Databricks workspace

    - Grant it appropriate permissions on Unity Catalog

  3. Try setting environment variable to disable browser-based auth:

  os.environ["DATABRICKS_AUTH_TYPE"] = "azure-client-secret"

  Let me know if the popup still appears after these changes!