import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"

nbakh — Mon, 26 Sep 2022 13:22:10 GMT

The error i get when importing certain delta table is

The specified schema does not match the existing schema at dbfs:/mnt/mart/tablename

however, when i check the metadata table in the old workspace and the exported file, they match. However, it seems that whatever the metadata is in the external location above is different.

The main difference is that the for many of the columns in dbfs:/mnt the column type is string while the metadata from the metastore shows varchar255.

Can anyone advise why there would be a difference and a way to resolve it

Re: import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"

nbakh — Mon, 26 Sep 2022 13:39:09 GMT

below is example error. however, in existing metadata i still see varchar 100 as the type.

Specified metadata for field Percentage is different from existing schema:\n Specified: {}\n Existing: {\"HIVE_TYPE_STRING\":\"varchar(100)\"}\n\nIf your intention is to keep the existing schema

topic import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema" in Data Engineering

import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"

Re: import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"