cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How to handle schema changes in streaming Delta Tables?

Leszek
Contributor

I'm using Structure Streaming when moving data from one Delta Table to another.

How to handle schema changes in those tables (e.g. adding new column)?

1 REPLY 1

Murthy1
Contributor II

Hello,

I think the only way of handling is to mention the schema within the job through a schema file. The other way is to restart the job to infer the new schema automatically.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.