cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Does Databricks offer something like Oracle's dblink?

quakenbush
Contributor

I am aware, I can load anything into a DataFrame using JDBC, that works well from Oracle sources. Is there an equivalent in Spark SQL, so I can combine datasets as well?

Basically something like so - you get the idea...

select
    lt.field1,
    rt.field2
from localTable lt
join remoteTable@serverLink rt
    on rt.id = lt.id

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Anonymous
Not applicable

dblink does not exist. What you can do is create two table statements with jdbc sources and then do a join of the two tables. It will be a little more to write, but you'll get the correct table in the end.

In python you can maybe do it easier with something like:

spark.read.jdbc(config1).join(spark.read.jdbc(config2), "key", "type")

View solution in original post

4 REPLIES 4

Anonymous
Not applicable

dblink does not exist. What you can do is create two table statements with jdbc sources and then do a join of the two tables. It will be a little more to write, but you'll get the correct table in the end.

In python you can maybe do it easier with something like:

spark.read.jdbc(config1).join(spark.read.jdbc(config2), "key", "type")

AdrianLobacz
Contributor

quakenbush
Contributor

Thanks everyone for helping.

Kaniz
Community Manager
Community Manager

Hi @Roger Bieri​  (Customer)​, I appreciate your attempt to choose the best answer for us. I'm glad you got your query resolved. @Joseph Kambourakis​ and @Adrian Łobacz​, Thank you for giving excellent answers 😀.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!