cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Read Delta Table with Pandas

User16830818524
New Contributor II

Is it possible to read a Delta table directly into a Pandas Dataframe?

1 REPLY 1

Anand_Ladda
Honored Contributor II

You'd have convert a delta table to pyarrow and then use to_pandas. See https://databricks.com/blog/2020/12/22/natively-query-your-delta-lake-with-scala-java-and-python.htm... for details

# Create a Pandas Dataframe by initially converting the Delta Lake

# table into a PyArrow table

df = dt.to_pyarrow_table().to_pandas()

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.