Optimization failed for timestampNtz

Jennifer
New Contributor III

We have a table using timestampNtz type for timestamp, which is also a cluster key for this table using liquid clustering. I ran OPTIMIZE <table-name>, it failed with error

Unsupported datatype 'TimestampNTZType'

 But the failed optmization also broke the query that filters on this field. Query as below will fail

select * from table-name
WHERE field_name>'2024-01-02'

 with error

TimestampNTZType (of class org.apache.spark.sql.types.TimestampNTZType$)

 How am I suppose to solve this issue?