topic Re: List files in Databricks Workspace with Databricks CLI in Administration & Architecture

List files in Databricks Workspace with Databricks CLI

Stefan-Koch — Thu, 31 Oct 2024 20:40:27 GMT

I want to list all files in my Workspace with the CLI

There's a command for it:

databricks fs ls dbfs:/

When I run this, I get this result:

I can then list the content of databricks-datasets, but no other directory.

How can I list the content of the Workspace? Or how can I list as example this:

Re: List files in Databricks Workspace with Databricks CLI

MaximeGendre — Thu, 31 Oct 2024 21:56:54 GMT

Hello,
workspace files are not stored in the DBFS.
If you want to use the CLI :

first :

%pip install -U -qqqq databricks-sdk

then :

from databricks.sdk import WorkspaceClient

client = WorkspaceClient()

for i in client.workspace.list(f'/<your_path>', recursive=True😞

print(i.path)

Documentation is available here :

https://databricks-sdk-py.readthedocs.io/en/latest/workspace/workspace/workspace.html

Re: List files in Databricks Workspace with Databricks CLI

Stefan-Koch — Fri, 01 Nov 2024 04:27:27 GMT

I know it's possible with Databricks SDK, but I want to solve it with the CLI on the Terminal.