topic Re: Databrick IP address in Data Engineering

Databrick IP address

swathiG — Thu, 20 Jun 2024 05:00:59 GMT

I'm trying to call api in databricks notebook .But while calling api inside databricks notebook it is giving error saying "403" forbidden.
I think it seems issue with IP address
can any one help me to know which IP of databricks need to be whitelisted in order to call api and where can I find it.

Re: Databrick IP address

jacovangelder — Thu, 20 Jun 2024 05:47:56 GMT

Might be worth adding what public cloud you are on and if you are using secure cluster connectivity

Re: Databrick IP address

swathiG — Thu, 20 Jun 2024 06:00:08 GMT

@jacovangelder My databricks workspace is hosted in AWS so I tried to add the region,Inbound and outbound IP address But it is not working

Re: Databrick IP address

jacovangelder — Thu, 20 Jun 2024 06:16:07 GMT

I don't know your enterprise setup, but it could be that the AWS firewall is blocking the outbound request too. Just whitelisting the AWS Databricks ranges in the application you're posting to might not be enough.

Edit: actually no that can't be the case because a 403 is remote server error.
You might have only whitelisted the control plane IPs and not the compute plane (cluster/VM ip's)

Which IP's did you use?

Re: Databrick IP address

swathiG — Thu, 20 Jun 2024 06:40:54 GMT

@jacovangelder yes, I have whitelisted control plane IP's inbound and outbound.
ap-south-1 65.0.37.64/28, 13.232.248.161

Re: Databrick IP address

swathiG — Thu, 20 Jun 2024 06:54:16 GMT

@jacovangelder
can you please let me know where can I get compute IP address

Re: Databrick IP address

jacovangelder — Thu, 20 Jun 2024 07:15:50 GMT

You can find it in the Spark Master UI settings in the cluster configuration.

Or you can run %sh ifconfig.

Do keep in mind you might want to take a range because this most likely changes everytime you spin up your cluster.

Re: Databrick IP address

swathiG — Thu, 20 Jun 2024 09:32:06 GMT

@jacovangelder
will try this thank you