01-30-2024 06:41 PM
This seems to be issue with spark and was able to fix issue by following posts
https://stackoverflow.com/questions/47020379/bigquery-simba-jdbc-error-with-spark
https://stackoverflow.com/questions/68013347/how-to-register-a-jdbc-spark-dialect-in-python/71913245...
fix is to update function in JdbcDialects.scala
def quoteIdentifier(colName: String): String = {colName}
https://github.com/apache/spark/blob/ce5ddad990373636e94071e7cef2f31021add07b/sql/core/src/main/scal...
View solution in original post
