Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-08-2023 03:38 AM
I also encountered the similar problem. This is a snippet from my log file:
22/12/18 09:36:28 WARN SnowflakeConnectorUtils$: Query pushdown is not supported because you are using Spark 3.2.0 with a connector designed to support Spark 3.1. Either use the version of Spark supported by the connector or install a version of the connector that supports your version of Spark.
22/12/18 09:36:29 INFO SparkConnectorContext$: Spark Connector system config: {
"spark_connector_version" : "2.9.0",
"spark_version" : "3.2.0",
"application_name" : "Databricks Shell",
"scala_version" : "2.12.14",
"java_version" : "11.0.12",
"jdbc_version" : "3.13.3",
"certified_jdbc_version" : "3.13.3",
"os_name" : "Linux",
......
}Shouldn't the versionioning of Snowflake connector be transparent for me (I use the one supplied by Databricks)?