โ05-04-2022 08:37 AM
โ05-20-2022 09:00 AM
Hi @Arun Rangarajanโ , You can go into the Spark cluster UI - Master tab within the cluster. The URL listed contains the IP for the driver and the workers' IPs are listed at the bottom.
Depending on your use case, it may be helpful to know that in an init script you can get the DB_DRIVER_IP from an environment variable.
https://docs.databricks.com/clusters/init-scripts.html#environment-variables
There are other environment variables set at runtime that can be accessed in a Scala notebook:
System.getenv.get("MASTER") // spark://10.255.128.6:7077
System.getenv.get("SPARK_LOCAL_IP") // 10.255.128.6
โ05-20-2022 09:00 AM
Hi @Arun Rangarajanโ , You can go into the Spark cluster UI - Master tab within the cluster. The URL listed contains the IP for the driver and the workers' IPs are listed at the bottom.
Depending on your use case, it may be helpful to know that in an init script you can get the DB_DRIVER_IP from an environment variable.
https://docs.databricks.com/clusters/init-scripts.html#environment-variables
There are other environment variables set at runtime that can be accessed in a Scala notebook:
System.getenv.get("MASTER") // spark://10.255.128.6:7077
System.getenv.get("SPARK_LOCAL_IP") // 10.255.128.6
โ06-02-2022 03:33 AM
Hi @Arun Rangarajanโ, Just a friendly follow-up. Do you still need help, or does the above response help you to find the solution? Please let us know.
โ06-02-2022 07:32 AM
yes, thx.
โ12-13-2022 11:38 PM
Thanks @Kaniz Fatmaโ
Actually, I was looking for the same and then got this blog
โ12-14-2022 04:48 AM
Wow!!!
Thank you for the heads up!!
@Ajay Pandeyโ
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.