com.databricks.sql.transaction.tahoe.ColumnMappingException: Found duplicated column id `2` in colum

[Poovarasan]

Hi,

Currently, I am using the below-mentioned query to create a materialized view. It was working fine until yesterday in the DLT pipeline, but from today on, the below-provided code throws an error (com.databricks.sql.transaction.tahoe.ColumnMappingException: Found duplicated column id `2` in colum). However, it works when I select only 4 columns in the select. Please let us know if anyone knows about this issue.

CREATE LIVE TABLE Sales

TBLPROPERTIES (

    'delta.minReaderVersion' = '2',

    'delta.minWriterVersion' = '5',

    'delta.columnMapping.mode' = 'name'

  )

AS

select Product_name as `Product Name`, id as `Order ID`,Date as `Order Date`, Price as `Total Amount`, Delivery_Date as 'Delivery Date'

from raw_Sales

[Poovarasan]

Hi @Retired_mod ,

In my case I do not have any duplicated columns in raw_sales and the existing DLT pipeline was working fine until 27th February 2024. We have tried to reach out databricks support. but we couldn't get any solution.