- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-16-2021 08:39 AM
Hi @Bertrand BURCKER as you have mentioned your zip file is large, can you let us know the size of the file?
Also, have you tried with a smaller zip file, and what is the result?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-26-2021 10:09 AM
My file is 180MiB. For information, the culster is a single node standard_F4s
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2021 05:39 AM
Another problem is that dbfs storage doesn't support random writes (used by zip):
Does not support random writes. For workloads that require random writes, perform the operations on local disk first and then copy the result to
/dbfs
source: https://docs.databricks.com/data/databricks-file-system.html#local-file-api-limitations
My blog: https://databrickster.medium.com/
