cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DownLoad CSV files from Delta Lake

Madalian
New Contributor III

We have around 1800 tables in Parq format (Delta Lake). These 1800 tables are very big, we have all these 1800 tables are converted into tables. But we have a requirement that, we need to download in CSV. (from PowerBI / any other reporting tool). Customer want to download full set of tables. I tried following ways.

1. Created paramterized Notebook to filter table and download from result set.

This method is not so liking by users.

Thanks

 

3 REPLIES 3

Kaniz_Fatma
Community Manager
Community Manager

Hi @MadalianIn Power BI, you can directly export data from a visualization to a CSV file. Hereโ€™s how:

  • Since you mentioned that youโ€™ve already converted the Parquet tables into tables, you can use Python scripting to export the data to CSV.
    • Write a Python script that reads the Parquet files and converts them to CSV.
    • Execute the script to generate CSV files.
    • Load these CSV files into Power BI.

 

jose_gonzalez
Moderator
Moderator

@Madalian did you have time to check Kaniz's response? does this help or you still need help? please let us know

Madalian
New Contributor III

Dear Kaniz,

Thank you. one doubt 1) converting tables data into CSV and saving again one more of storage layer.

IS there any way on fly we can convert these tables into CSV's. and export into PowerBI? and again i see in powerBI has limitations around > 5 gb downloads. we have some tables 10 GB +.

Thanks

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group