cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Does Databricks offer something like Oracle's dblink?

quakenbush
Contributor

I am aware, I can load anything into a DataFrame using JDBC, that works well from Oracle sources. Is there an equivalent in Spark SQL, so I can combine datasets as well?

Basically something like so - you get the idea...

select
    lt.field1,
    rt.field2
from localTable lt
join remoteTable@serverLink rt
    on rt.id = lt.id

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Anonymous
Not applicable

dblink does not exist. What you can do is create two table statements with jdbc sources and then do a join of the two tables. It will be a little more to write, but you'll get the correct table in the end.

In python you can maybe do it easier with something like:

spark.read.jdbc(config1).join(spark.read.jdbc(config2), "key", "type")

View solution in original post

4 REPLIES 4

Anonymous
Not applicable

dblink does not exist. What you can do is create two table statements with jdbc sources and then do a join of the two tables. It will be a little more to write, but you'll get the correct table in the end.

In python you can maybe do it easier with something like:

spark.read.jdbc(config1).join(spark.read.jdbc(config2), "key", "type")

quakenbush
Contributor

Thanks everyone for helping.

Kaniz
Community Manager
Community Manager

Hi @Roger Bieri​  (Customer)​, I appreciate your attempt to choose the best answer for us. I'm glad you got your query resolved. @Joseph Kambourakis​ and @Adrian Łobacz​, Thank you for giving excellent answers 😀.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.