cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to find out the databricks driver IP from Ganglia metrics UI?

Sun1
New Contributor II
 
1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz
Community Manager
Community Manager

Hi @Arun Rangarajanโ€‹ , You can go into the Spark cluster UI - Master tab within the cluster. The URL listed contains the IP for the driver and the workers' IPs are listed at the bottom.

imageDepending on your use case, it may be helpful to know that in an init script you can get the DB_DRIVER_IP from an environment variable.

https://docs.databricks.com/clusters/init-scripts.html#environment-variables

There are other environment variables set at runtime that can be accessed in a Scala notebook:

System.getenv.get("MASTER")         // spark://10.255.128.6:7077
System.getenv.get("SPARK_LOCAL_IP") // 10.255.128.6

View solution in original post

5 REPLIES 5

Kaniz
Community Manager
Community Manager

Hi @Arun Rangarajanโ€‹ , You can go into the Spark cluster UI - Master tab within the cluster. The URL listed contains the IP for the driver and the workers' IPs are listed at the bottom.

imageDepending on your use case, it may be helpful to know that in an init script you can get the DB_DRIVER_IP from an environment variable.

https://docs.databricks.com/clusters/init-scripts.html#environment-variables

There are other environment variables set at runtime that can be accessed in a Scala notebook:

System.getenv.get("MASTER")         // spark://10.255.128.6:7077
System.getenv.get("SPARK_LOCAL_IP") // 10.255.128.6

Kaniz
Community Manager
Community Manager

Hi @Arun Rangarajanโ€‹, Just a friendly follow-up. Do you still need help, or does the above response help you to find the solution? Please let us know.

Sun1
New Contributor II

yes, thx.

Ajay-Pandey
Esteemed Contributor III

Thanks @Kaniz Fatmaโ€‹ 

Actually, I was looking for the same and then got this blog

Kaniz
Community Manager
Community Manager

Wow!!!

Thank you for the heads up!!

@Ajay Pandeyโ€‹

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.