Variant type table within DLT

[udi_azulay]

Hi,

I have a table with Variant type (preview) and works well in 15.3, when i try to run a code that reference this Variant type in a DLT pipeline i get : 

com.databricks.sql.transaction.tahoe.DeltaUnsupportedTableFeatureException: [DELTA_UNSUPPORTED_FEATURES_FOR_READ] Unsupported Delta read feature: table "trace_api_poc.ctv_decoder" requires reader table feature(s) that are unsupported by this version of Databricks: variantType-preview. Please refer to https://docs.microsoft.com/azure/databricks/delta/feature-compatibility for more information on Delta Lake feature compatibility.

when i try to change the policy and define Databricks Runtime Version to be 15.3, i get :

INVALID_PARAMETER_VALUE: [DLT ERROR CODE: INVALID_CLUSTER_SETTING.CLIENT_ERROR] The cluster policy specified in the pipeline settings is not compatible with Delta Live Tables. Remove 'spark_version’ from your cluster policy.
Please advise!

[szymon_dybczak]

Hi @udi_azulay ,

That's because DLT currently sits on lower version. Look at release notes: 

https://docs.databricks.com/en/release-notes/delta-live-tables/2024/22/index.html

Databricks Runtime versions used by this release

Channel:

CURRENT (default): Databricks Runtime 14.1

PREVIEW: Databricks Runtime 14.3

[thomas-totter]

Preview channel version currently is at 15.2. So we should be only one minor version increment away from variant being available in DLT (at least i hope so...).