You can now add the WITH SCHEMA EVOLUTION clause to a SQL merge statement to enable schema evolution for the operation.
For more information: https://docs.databricks.com/en/delta/update-schema.html#sql-evo
#Databricks
You can now enable type widening on tables backed by Delta Lake. Tables with type widening enabled allow changing the type of columns to a wider data type without rewriting underlying data files.
For more information:https://docs.databricks.co...
Support for liquid clustering is now generally available using Databricks Runtime +15.2 Getting started with Delta Lake Liquid clustering https://lnkd.in/eaCZyhbF#DeltaLake #Databricks
Liquid will be a good option. Just make sure to run the optimize whenever you upsert data. Don't worry the optimize won't be expensive as it will run on only the latest data in order to cluster them and have fast queries
Databricks Learning Festival (Virtual) is back. The event starts on 29 February in celebration of Digital Learning Day and to help you leap into learning! 易
Access free, self-paced, role-based training
Earn a 50%-off Databricks certification vo...
