cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

is there a way to write streaming data to delta and create a table in spark catalog at the same time?

User16826987838
Contributor
 
1 REPLY 1

Ryan_Chynoweth
Honored Contributor III

Yes, in your write stream you can save it as a table in the delta format without a problem. In DBR 8, the default table format is delta.

See this code, please note that the "..." is supplied to show that additional options may be required:

df.writeStream.format("delta")...saveAsTable("<tablename>")

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.