How to write to a folder in a Azure Data Lake container using Delta?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-26-2022 01:52 AM
Hi All,
How to write to a folder in a Azure Data Lake container using Delta?
When I run:
write_mode = 'overwrite'
write_format = 'delta'
save_path = '/mnt/container-name/folder-name'
df.write \
.mode(write_mode) \
.format(write_format) \
.save(save_path)I get an incompatible format error. This does not happen when I write directly to the container ('/mnt/container-name').
I have also tried writing using the SQL commands but I get the same error.
What am I doing wrong?
Labels:
- Labels:
-
Azure data lake
-
Write
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2022 05:07 PM
Hi @Kamalen Reddy ,
Could you share the error message please?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-25-2022 02:42 PM
Hi @Kamalen Reddy,
Just a friendly follow-up. Do you still need help? please let us know