Priyanka_Biswas
Databricks Employee
Databricks Employee

Hi @kll

This error is because of schema validation. The delta table performs schema validation of every column, and the source dataframe column data types must match the column data types in the target table. If they don’t match, an exception is raised.

For reference-

https://docs.databricks.com/delta/delta-batch.html#schema-validation-1


Could you please refer below 2 article and see if it helps ?
  1. https://community.databricks.com/s/question/0D58Y00008k0YO8SAM/failed-to-merge-incompatible-data-typ...
  2. https://kb.databricks.com/en_US/data/wrong-schema-in-files