cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks (GCP) Cluster not resolving Hostname into IP address

Sadam97
New Contributor

Thursday

we have #mongodb hosts that must be resolved to private internal loadbalancer ips ( of another cluster ), and that we are unable to add host aliases in the Databricks GKE cluster in order for the spark to be able to connect to a mongodb and resolve the mongodb hostname into ip address. Databricks workspace is in VPC as mongodb cluster and has subnet access as we are able to telnet the mongodb node ip from databricks noteboo

Getting error, Timed out after 30000 ms while waiting for a server that matches .

0 Kudos
1 REPLY 1

Kaniz_Fatma
Community Manager
Community Manager

yesterday

  • Check if your DNS server is responding. You can do this by running a ping command from a notebook in Databricks to reach your secondary DNS server.
  • Edit the /etc/resolv.conf file on the cluster and update the nameserver value with a working DNS server. Save the changes and restart systemd-resolved.
  1.  

Feel free to try these steps, and let me know if you need further assistance! ๐Ÿš€

 
0 Kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Announcements