Too long hive type string
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-22-2022 05:09 AM
Hello community!
I have a table with a column that is an array of a struct that has a very very long schema.
When the table is written, all works well. Though, when I create a view based on this table and I try to access the view I get the error:
rg.apache.spark.SparkException: Cannot recognize hive type string: array<struct<hitNumber:bigint....,latencyTracking:struct<pageLoadSample:bigint,pageLoadTime:bigint,pageDownloadTime:bigin, column: hits, db: test, table: testas you see the actual schema has been truncated at the end, before the column name comes.
The question is: is there a configuration on the size of the hive type string I could play with?
Thank you in advance,
Labels:
- Labels:
-
Azure databricks
-
Table