topic Re: WorkspaceClient authentication fails when running on a Docker cluster in Data Engineering

WorkspaceClient authentication fails when running on a Docker cluster

JohanS — Thu, 11 Apr 2024 07:03:47 GMT

from databricks.sdk import WorkspaceClient
w = WorkspaceClient()

ValueError: default auth: cannot configure default credentials ...

I'm trying to instantiate a WorkspaceClient in a notebook on a cluster running a Docker image, but authentication fails.
The Docker image is based on databricksruntime/python:13.3-LTS, and databricks-sdk 0.24.0 is installed during build.

Running the same code on a non-Docker cluster works, after updating the databricks-sdk.
What else can I do to make this work?

Re: WorkspaceClient authentication fails when running on a Docker cluster

Srihasa_Akepati — Fri, 10 May 2024 10:27:34 GMT

@JohanS As discussed, Default auth from a notebook using sdk on DCS is yet to be tested by Engineering. Please use PAT auth for now. I will keep you posted on the progress default auth on DCS.

Re: WorkspaceClient authentication fails when running on a Docker cluster

kyle_scherer1_5 — Mon, 16 Jun 2025 14:31:57 GMT

Any progress here? Same issue, over a year later