In your .env file, add:
DATABRICKS_WORKSPACE_RESOURCE_ID=/subscriptions/your-sub-id/resourceGroups/your-rg/providers/Microsoft.Databricks/workspaces/your
-workspace
Alternative approaches if the popup persists:
1. Use OAuth machine-to-machine (M2M) authentication (recommended for newer workspaces):
auth_type="databricks-oauth"
2. Ensure your service principal has proper permissions:
- The SP needs to be added as a user in your Databricks workspace
- Grant it appropriate permissions on Unity Catalog
3. Try setting environment variable to disable browser-based auth:
os.environ["DATABRICKS_AUTH_TYPE"] = "azure-client-secret"
Let me know if the popup still appears after these changes!