topic Re: Load data from Aurora to Databricks directly in Data Engineering

Load data from Aurora to Databricks directly

creditorwatch — Wed, 28 Feb 2024 00:44:17 GMT

Hi,

Does anyone know how to link Aurora to Databricks directly and load data into Databricks automatically on a schedule without any third-party tools in the middle?

Re: Load data from Aurora to Databricks directly

kelvinmedina — Fri, 21 Feb 2025 17:53:55 GMT

The same doubt here.

Re: Load data from Aurora to Databricks directly

MariuszK — Fri, 21 Feb 2025 18:35:34 GMT

AWS Aurora supports PostgreSQL or MySQL, did you try to connect using JDBC?

url = f"jdbc:postgresql://{database_host}:{database_port}/{database_name}"

remote_table = (spark.read
.format("jdbc")
.option("driver", driver)
.option("url", url)
.option("dbtable", table)
.option("user", user)
.option("password", password)
.load()
)