topic Re: Enable automatic schema evolution for Delta Lake merge for an SQL warehouse in Administration & Architecture

Enable automatic schema evolution for Delta Lake merge for an SQL warehouse

807326 — Mon, 07 Aug 2023 11:44:20 GMT

Hello!

We tried to update our integration scripts and use SQL warehouses instead of general compute clusters to fetch and update data, but we faced a problem. We use automatic schema evolution when we merge tables, but with SQL warehouse, when we try to enable it before running a merge query (set spark.databricks.delta.schema.autoMerge.enabled = true), we get an error:

databricks.sql.exc.DatabaseError: Error running query: [_LEGACY_ERROR_TEMP_DBR_0222] org.apache.spark.sql.AnalysisException: Configuration spark.databricks.delta.schema.autoMerge.enabled is not available.

Is there any way to enable automatic schema evolution for Delta Lake merge for an SQL warehouse?

Re: Enable automatic schema evolution for Delta Lake merge for an SQL warehouse

BerkerKozan — Wed, 28 Feb 2024 17:29:13 GMT

Is there any update on that one?

Re: Enable automatic schema evolution for Delta Lake merge for an SQL warehouse

TheKnightCoder — Thu, 09 May 2024 02:58:16 GMT

why can we not enable autoMerge in SQL warehouse when my tables are delta tables?

Re: Enable automatic schema evolution for Delta Lake merge for an SQL warehouse

User16844475297 — Wed, 17 Sep 2025 20:18:42 GMT

This feature has been released. Please see docs for more details - https://docs.databricks.com/aws/en/sql/language-manual/delta-merge-into#with-schema-evolution