Error org.apache.spark.SparkSQLException: Unsupported type TIMESTAMP_WITH_TIMEZONE
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-03-2023 04:17 AM
Hi Guys,
I am trying to load data from a custom JDBC data source like below. I am getting this error, in spite of specifying "customSchema" attribute on the timestamp column. Do you know how to resolve this?
material_master = spark.read \
.format("jdbc") \
.option("url","<my jdbc url>") \
.option("driver", "<my jdbc driver>") \
.option("customSchema", "timestamp STRING") \
.option("query","SELECT CONO, STAT, ITNO, timestamp FROM MITMAS LIMIT 10") \
.load()
Labels:
- Labels:
-
CustomJDBC