Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2021 05:39 AM
Another problem is that dbfs storage doesn't support random writes (used by zip):
Does not support random writes. For workloads that require random writes, perform the operations on local disk first and then copy the result to
/dbfs
source: https://docs.databricks.com/data/databricks-file-system.html#local-file-api-limitations
My blog: https://databrickster.medium.com/