Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-11-2022 02:32 AM
Hi @Hubert Dudek. Do you know if this works also for identity columns? Is there another way to do this? The below returns ParseException. Thank you
tt = spark.read.table("table_name") \
.withColumn("ID",col("ID").cast("BIGINT GENERATED ALWAYS")) \
.write \
.format("delta") \
.mode("overwrite") \
.option("overwriteSchema", "true") \
.saveAsTable("table_name")