Where / how does DBFS store files?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-05-2022 12:19 AM
I tried to use %fs head to print the contents of a CSV file used in a training
%fs head "/mnt/path/file.csv"but got an error saying cannot head a directory!?
Then I did %fs ls on the same CSV file and got a list of 4 files under a directory named as a CSV file.
A little confused how DBFS stores files on underlying storage and where they are stored. I am using community edition.
any pointers appreciated. Thanks.
EDIT: Apache iceberg has a illustration that shows the internal logical/storage structure well. Is there something similar for DBFS?
Labels:
- Labels:
-
DBFS
-
Mount Point
-
Storage