topic Does Databricks offer something like Oracle's dblink? in Data Engineering

Does Databricks offer something like Oracle's dblink?

quakenbush — Wed, 18 Jan 2023 15:16:21 GMT

I am aware, I can load anything into a DataFrame using JDBC, that works well from Oracle sources. Is there an equivalent in Spark SQL, so I can combine datasets as well?

Basically something like so - you get the idea...

select
    lt.field1,
    rt.field2
from localTable lt
join remoteTable@serverLink rt
    on rt.id = lt.id

Thanks

Re: Does Databricks offer something like Oracle's dblink?

Anonymous — Wed, 18 Jan 2023 16:00:08 GMT

dblink does not exist. What you can do is create two table statements with jdbc sources and then do a join of the two tables. It will be a little more to write, but you'll get the correct table in the end.

In python you can maybe do it easier with something like:

spark.read.jdbc(config1).join(spark.read.jdbc(config2), "key", "type")

Re: Does Databricks offer something like Oracle's dblink?

AdrianLobacz — Thu, 19 Jan 2023 07:36:20 GMT

Here are the methods you can leverage to establish Databricks Connect to Oracle Database seamlessly:

Check this link:

https://hevodata.com/learn/databricks-connect-to-oracle-database/#7

Re: Does Databricks offer something like Oracle's dblink?

quakenbush — Thu, 19 Jan 2023 08:35:48 GMT

Thanks everyone for helping.