Where / how does DBFS store files?

al_joe
Contributor

I tried to use %fs head to print the contents of a CSV file used in a training

%fs head "/mnt/path/file.csv"

but got an error saying cannot head a directory!?

Then I did %fs ls on the same CSV file and got a list of 4 files under a directory named as a CSV file.

screenshot 

A little confused how DBFS stores files on underlying storage and where they are stored. I am using community edition.

any pointers appreciated. Thanks.

EDIT: Apache iceberg has a illustration that shows the internal logical/storage structure well. Is there something similar for DBFS? 

image