We have a process that creates a table in Synapse then attempts to write the Data generated in Databricks to it. We are able to create the table no problem but when we go to copy the data we keep getting an error that the column has a data type that cannot participate in a columnstore index. The column type is int not any type of max field. I tried creating the table with no column index store through the create table statement option below but am having no luck.
WITH
(
DISTRIBUTION = ROUND_ROBIN,
HEAP
)
Does anyone have suggestions as to how to get around this?