Cannot create delta live table

rocky5 — Wed, 30 Nov 2022 09:14:24 GMT

I created a simple definition of delta live table smth like:

CREATE OR REFRESH STREAMING LIVE TABLE customers_silver

AS SELECT * FROM STREAM(LIVE.customers_bronze)

But I am getting an error when running a pipeline:

com.databricks.sql.transaction.tahoe.DeltaColumnMappingUnsupportedException: Changing column mapping mode from 'name' to 'none' is not supported.

When I remove that notebook (with above definition), pipeline runs correctly for 3 upcoming kafka streams (which I would like to use in above query definition). Do you know what might cause that error?

Re: Cannot create delta live table

jose_gonzalez — Tue, 31 Jan 2023 00:26:13 GMT

You might need to execute the following on your tables to avoid this error message

ALTER TABLE <table_name> SET TBLPROPERTIES (

'delta.minReaderVersion' = '2',

'delta.minWriterVersion' = '5',

'delta.columnMapping.mode' = 'name'

)

Docs https://docs.databricks.com/delta/delta-column-mapping.html

topic Cannot create delta live table in Data Engineering

Cannot create delta live table

Re: Cannot create delta live table