NiFi on EKS Fails to Connect to Databricks via JDB... - Databricks Community

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.

I'm using Apache Nifi (running on AWS EKS) to connect to Databricks (with compute on EC2) via JDBC. My JDBC URL is as follows:

jdbc:databricks://server_hostname:443/default;transportMode=http;ssl=1;httpPath=my_httppath;AuthMech=3;UID=token;PWD=my_token. However, I encountered the following error:

I have verified that:

I can successfully telnet from my NiFi pod to the Databricks host on port 443.
The necessary network security settings (firewalls, security groups) allow connections from the NiFi IP range.
I can connect to Databricks using the same JDBC URL from DBeaver on my pc without any issues.

Can anyone please explain why NiFi is encountering a "Connection reset" error when connecting to Databricks via JDBC, and provide suggestions on how to resolve this issue?