topic Re: SQL compilation error while connecting to snowflake from Databricks in Data Engineering

SQL compilation error while connecting to snowflake from Databricks

Kaviprakash_S — Mon, 10 Jun 2024 02:34:19 GMT

Hi All,

I'm trying to connect to the snowflake database from databricks notebook either to read the data or write the data. However I'm getting an weird error. The code and error are provided as follows,

snowflake_table = (spark.read

.format("snowflake")

.option("host", "******.east-us-2.azure.snowflakecomputing.com")

.option("user", "******")

.option("password", "*********")

.option("sfWarehouse", "Compute_WH")

.option("database", "SalesDevDB")

.option("schema", "gold") # Optional - will use default schema "public" if not specified.

.option("dbtable", "test")

.load()

)

Error:

net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:

Re: SQL compilation error while connecting to snowflake from Databricks

brickster_2018 — Mon, 10 Jun 2024 08:55:42 GMT

Can you try the below code snippet? And share the stacktrace if the issue persists.

snowflake_table = spark.read \ .format("snowflake") \ .option("host", "******.east-us-2.azure.snowflakecomputing.com") \ .option("user", "******") \ .option("password", "*********") \ .option("sfWarehouse", "Compute_WH") \ .option("database", "SalesDevDB") \ .option("schema", "gold") \ .option("dbtable", "test") \ .load()

Re: SQL compilation error while connecting to snowflake from Databricks

Kaviprakash_S — Mon, 10 Jun 2024 16:25:57 GMT

I don't think adding the "\" will work in this case. Infact its not required in this dataframe operation.

Re: SQL compilation error while connecting to snowflake from Databricks

Kaviprakash_S — Tue, 11 Jun 2024 20:16:44 GMT

@Retired_mod Could you please help with this ?