how do we use delta sharing between databricks to snowflake

[sher]

Hi all,

Is there any way to implement delta sharing in databricks to snowflake direct connect ?

[Kaniz]

Hi @sher, 

Delta sharing is a secure data sharing platform that lets you share data in Databricks with users ou...t. Snowflake direct connect is a feature that allows you to connect to Snowflake without using the JDBC....

To implement delta sharing in Databricks to Snowflake direct connect, you need to do the following steps:

• Enable delta sharing for your Databricks account as a provider. This will allow you to share data from your Unity Catalog-enabled workspace with users who also have....
• Configure a connection to Snowflake using the Snowflake connector in the Databricks Runtime. You can specify the host, port, user, password, warehouse name, database name, schema name, and tabl....
• Query data from Snowflake using Spark SQL or DataFrame API. You can use the same syntax as querying data from any other external data source.
• Optionally, you can also share notebooks that contain code or data from your Databricks workspace with users who have access to delta sharing. You can use the Share button in the notebook toolbar or the share() method in Python or Scala.

I hope this helps you understand how to implement delta sharing in Databricks to Snowflake direct connect. 

If you have any more questions, feel free to ask me 😊.

[sher]

i want to share the delta table and snowflake read it as external table. i dont want any python apis to load the. it should have it in external table mode itself. can you please check n let us know

[NateAnth]

I don't think that Snowflake has implemented the ability to read from a table via Delta Sharing as of December 2023. Please reach out to your Snowflake representatives and urge them to consider this feature from their side. 

Alternatively, you can query existing data from Snowflake with Lakehouse Federation as well as the table that is residing in Databricks.  A Databricks SQL Warehouse would be great way to query data stored in Databricks as well as Snowflake via Lakehouse Federation via SQL.

[sher]

sure will take a look on this