Hi All,
How to write to a folder in a Azure Data Lake container using Delta?
When I run:
write_mode = 'overwrite'
write_format = 'delta'
save_path = '/mnt/container-name/folder-name'
df.write \
.mode(write_mode) \
.format(write_format) \
.save(save_path)
I get an incompatible format error. This does not happen when I write directly to the container ('/mnt/container-name').
I have also tried writing using the SQL commands but I get the same error.
What am I doing wrong?