Cannot up cast sizeInBytes from string to bigint
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-31-2024 07:50 AM
I am creating a basic delta table using CREATE SQL query
CREATE TABLE test_transact (transaction_id string, post_date date)and running this query throws an error "Cannot up cast sizeInBytes from string to bigint"
Even if I try to create a dataframe and save as table,
df.write.format("delta").mode("overwrite").saveAsTable("test_transact")same error appears, despite there is no column sizeInBytes being used.
However, I can able to create temp view using df.createOrReplaceTempView("test_transact")
My cluster DBR version is 14.3 LTS ML (Spark 3.5.0, Scala 2.12)
Can anyone encountered such issue? Appreciate you help... here is the screenshot