cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DownLoad CSV files from Delta Lake

Madalian
New Contributor III

We have around 1800 tables in Parq format (Delta Lake). These 1800 tables are very big, we have all these 1800 tables are converted into tables. But we have a requirement that, we need to download in CSV. (from PowerBI / any other reporting tool). Customer want to download full set of tables. I tried following ways.

1. Created paramterized Notebook to filter table and download from result set.

This method is not so liking by users.

Thanks

 

3 REPLIES 3

Kaniz_Fatma
Community Manager
Community Manager

Hi @MadalianIn Power BI, you can directly export data from a visualization to a CSV file. Hereโ€™s how:

  • Since you mentioned that youโ€™ve already converted the Parquet tables into tables, you can use Python scripting to export the data to CSV.
    • Write a Python script that reads the Parquet files and converts them to CSV.
    • Execute the script to generate CSV files.
    • Load these CSV files into Power BI.

 

jose_gonzalez
Moderator
Moderator

@Madalian did you have time to check Kaniz's response? does this help or you still need help? please let us know

Madalian
New Contributor III

Dear Kaniz,

Thank you. one doubt 1) converting tables data into CSV and saving again one more of storage layer.

IS there any way on fly we can convert these tables into CSV's. and export into PowerBI? and again i see in powerBI has limitations around > 5 gb downloads. we have some tables 10 GB +.

Thanks

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!