09-05-2023 01:08 AM
Hello,
How can I configure a foreign catalog connection to use SSH tunneling? I want to be able to use unity catalog
09-06-2023 07:18 AM
Hi @kashy , Could you please file a support ticket with us?
09-11-2023 01:47 AM
I cannot seem to get the link to raise a support ticket - just diverts me back here!
09-11-2023 12:53 AM
Hi, in addition to our previous message, you can try https://docs.databricks.com/en/query-federation/foreign-catalogs.html and https://grant-6562.medium.com/connecting-to-sql-server-through-an-ssh-tunnel-with-python-17de859caca....
Also please tag @Debayan with your next response which will notify me, Thank you!
09-11-2023 01:49 AM
thanks @Debayan that might work for a JDBC connection but I want to use in a foreign connection with unity catalog which this would not work with
09-13-2023 09:41 PM
Hi ,
You work with foreign catalogs in the same way that you work with any catalog managed by Unity Catalog:
View information about a foreign catalog: see View catalog details.
In addition to the information that is displayed for standard Unity Catalog catalogs, Catalog Explorer also displays the Connection used by the foreign catalog and the external database or catalog that is mirrored by the foreign catalog.
Run read-only queries on tables in foreign catalogs: see Query data.
When you write queries in Databricks, you must use Apache Spark data types. For a mapping of Spark data types to your external database data types, see the article for your connection type, listed in the table of contents in the left navigation pane of this documentation site.
Grant read-only access to data in foreign catalogs: see Manage privileges in Unity Catalog.
Get data lineage for tables in foreign catalogs: see Capture and view data lineage with Unity Catalog.
To learn how to create foreign catalogs, see Create a foreign catalog.
09-15-2023 09:50 AM
Hi @Debayan the issue is the lack of support for ssh tunnels - there is no configuration for these on foreign catalog connections
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group