DownLoad CSV files from Delta Lake
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-30-2024 02:00 AM
We have around 1800 tables in Parq format (Delta Lake). These 1800 tables are very big, we have all these 1800 tables are converted into tables. But we have a requirement that, we need to download in CSV. (from PowerBI / any other reporting tool). Customer want to download full set of tables. I tried following ways.
1. Created paramterized Notebook to filter table and download from result set.
This method is not so liking by users.
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-30-2024 04:51 PM
@Madalian did you have time to check Kaniz's response? does this help or you still need help? please let us know
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-30-2024 08:07 PM
Dear Kaniz,
Thank you. one doubt 1) converting tables data into CSV and saving again one more of storage layer.
IS there any way on fly we can convert these tables into CSV's. and export into PowerBI? and again i see in powerBI has limitations around > 5 gb downloads. we have some tables 10 GB +.
Thanks

