โ11-05-2021 02:39 AM
Why does /dbfs seem to be empty in my Databricks cluster ?
If I run
%sh ls /dbfs
I get no output.
I am looking for the databricks-datasets subdirectory ? I can't find it under /dbfs
โ11-05-2021 02:53 AM
Hi @Femi Anthonyโ Please let us know if you are trying this in Community edition or in your workspace?
If it's CE then you won't be able to see anything under /dbfs while using %sh.
display(dbutils.fs.ls("/")) should show the dataset folder.
โ11-05-2021 02:50 AM
Hi @Femi Anthonyโ , Do you see any results on executing: display(dbutils.fs.ls("/"))?
What's the DBR version of the cluster?
โ11-05-2021 02:53 AM
Hi @Femi Anthonyโ Please let us know if you are trying this in Community edition or in your workspace?
If it's CE then you won't be able to see anything under /dbfs while using %sh.
display(dbutils.fs.ls("/")) should show the dataset folder.
โ11-05-2021 07:12 AM
Yes, this is in Community ediition. Thanks.
โ11-05-2021 07:34 AM
Okay. Then this is the limitation with CE.
Use display(dbutils.fs.ls("/"))
โ11-08-2021 12:52 PM
Hi @Femi Anthonyโ ,
If @Prabakar Ammeappinโ's response helped you to solve your question? would you be happy to mark his answer as best so that others can quickly find the solution in the future
โ11-09-2021 01:09 AM
Thanks @Prabakar Ammeappinโ
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group