Cannot create delta live table
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-30-2022 01:14 AM
I created a simple definition of delta live table smth like:
CREATE OR REFRESH STREAMING LIVE TABLE customers_silver
AS SELECT * FROM STREAM(LIVE.customers_bronze)
But I am getting an error when running a pipeline:
com.databricks.sql.transaction.tahoe.DeltaColumnMappingUnsupportedException: Changing column mapping mode from 'name' to 'none' is not supported.
When I remove that notebook (with above definition), pipeline runs correctly for 3 upcoming kafka streams (which I would like to use in above query definition). Do you know what might cause that error?
- Labels:
-
Delta
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-30-2023 04:26 PM
You might need to execute the following on your tables to avoid this error message
ALTER TABLE <table_name> SET TBLPROPERTIES (
'delta.minReaderVersion' = '2',
'delta.minWriterVersion' = '5',
'delta.columnMapping.mode' = 'name'
)
Docs https://docs.databricks.com/delta/delta-column-mapping.html

