Too long hive type string

pantelis_mare
Contributor III

Hello community!

I have a table with a column that is an array of a struct that has a very very long schema.

When the table is written, all works well. Though, when I create a view based on this table and I try to access the view I get the error:

rg.apache.spark.SparkException: Cannot recognize hive type string: array<struct<hitNumber:bigint....,latencyTracking:struct<pageLoadSample:bigint,pageLoadTime:bigint,pageDownloadTime:bigin, column: hits, db: test, table: test

as you see the actual schema has been truncated at the end, before the column name comes.

The question is: is there a configuration on the size of the hive type string I could play with?

Thank you in advance,