com.databricks.sql.transaction.tahoe.ColumnMappingException: Found duplicated column id `2` in colum

Poovarasan
Databricks Partner

‎03-01-2024 03:30 AM

Hi,

Currently, I am using the below-mentioned query to create a materialized view. It was working fine until yesterday in the DLT pipeline, but from today on, the below-provided code throws an error (com.databricks.sql.transaction.tahoe.ColumnMappingException: Found duplicated column id `2` in colum). However, it works when I select only 4 columns in the select. Please let us know if anyone knows about this issue.

CREATE LIVE TABLE Sales
TBLPROPERTIES (
    'delta.minReaderVersion' = '2',
    'delta.minWriterVersion' = '5',
    'delta.columnMapping.mode' = 'name'
  )
AS
select Product_name as `Product Name`, id as `Order ID`,Date as `Order Date`, Price as `Total Amount`, Delivery_Date as 'Delivery Date'
from raw_Sales
0 Kudos

Poovarasan
Databricks Partner
In response to Retired_mod

‎03-03-2024 11:45 PM

Hi @Retired_mod ,

In my case I do not have any duplicated columns in raw_sales and the existing DLT pipeline was working fine until 27th February 2024. We have tried to reach out databricks support. but we couldn't get any solution.

0 Kudos