topic Snowflake connection to databricks error in Get Started Discussions

Snowflake connection to databricks error

shivank25 — Thu, 06 Jul 2023 08:40:06 GMT

I am trying to connect to snowflake using data bricks but getting the below error

net.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver encountered a communication error. Message: Exception encountered for HTTP request: Connect to xxx.region.snowflakecomputing.com:443 [XXX.region.snowflakecomputing.com/, XXX.region.snowflakecomputing.com/] failed: Read timed out.

user = dbutils.secrets.get("data-warehouse", "snowflake-user")

password = dbutils.secrets.get("data-warehouse", "snowflake-password")

SNOWFLAKE_SOURCE_NAME = "net.snowflake.spark.snowflake"

options = {

"sfUrl": "xxx.snowflakecomputing.com",

"sfUser": user,

"sfPassword": password,

"sfDatabase": "DB",

"sfSchema": "schema",

"sfWarehouse": "wharehouse"

}

snowflake_df = spark.read \

.format(SNOWFLAKE_SOURCE_NAME) \

.options(**options) \

.option("dbtable", "table") \

.load()

display(snowflake_df)

can you please let me know if I am missing something?

Re: Snowflake connection to databricks error

Priyanka_Biswas — Fri, 07 Jul 2023 03:44:07 GMT

Hello @shivank25, Databricks provides a Snowflake connector in the Databricks Runtime to support reading and writing data from Snowflake.

Could you please try with below code and let me know if it works for you ?

snowflake_table = (spark.read
.format("snowflake")
.option("dbtable", table_name)
.option("sfUrl", database_host_url)
.option("sfUser", username)
.option("sfPassword", password)
.option("sfDatabase", database_name)
.option("sfSchema", schema_name)
.option("sfWarehouse", warehouse_name)
.load()

#Use snowflake connector

df = spark.read \
.format("snowflake") \
.options(options) \
.option("dbtable", "table_name") \
.load()
display(df)

Ref: https://docs.databricks.com/external-data/snowflake.html

Re: Snowflake connection to databricks error

shivank25 — Fri, 07 Jul 2023 13:29:41 GMT

Thanks for your response @Priyanka_Biswas .

I am getting the below error now

net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:

--------------------------------------------------------------------------- Py4JJavaError Traceback (most recent call last) File <command-4201251452332141>:1 ----> 1 snowflake_table = (spark.read 2 .format("snowflake")

Re: Snowflake connection to databricks error

Anonymous — Wed, 12 Jul 2023 09:45:42 GMT

Hi @shivank25

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance!