Hostname not resolving using Spark JDBC

Splush_ — Mon, 17 Feb 2025 10:45:50 GMT

Hey guys,

Ive ran into a weird error this morning. Last week I was testing a new Oracle Connector and it ran through smooth the whole last week!

This morning at 7 it ran again and following it was showing a "SQLRecoverableException: IO Error: Unknown host specified" exception on every single run.

The weird thing is, that it is working on other compute - just not the one Im actually using for production. If I do an nslookup, it will resolve the ip just fine and using this exact IP, the jdbc query will work. If I use the hostname straight away inside of the jdbc query, it will not work (although it did last week).

Here is the code I use for fetching the data:

df = spark.read.format("jdbc").option("driver", "oracle.jdbc.driver.OracleDriver") \ .option("url", jdbc_url) \ .option("dbtable", query) \ .option("user", username) \ .option("password", password) \ .load()

Re: Hostname not resolving using Spark JDBC

Splush_ — Tue, 18 Feb 2025 16:02:14 GMT

I have even cloned the cluster and it worked on the new one. But after turning the cluster off over night, it started working again the next morning. This is really weird.

topic Re: Hostname not resolving using Spark JDBC in Data Engineering

Hostname not resolving using Spark JDBC

Re: Hostname not resolving using Spark JDBC