IP address fix
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-21-2021 12:14 AM
How can I fix the IP address of my Azure Cluster so that I can whitelist the IP address to run my job daily on my python notebook? Or can I find out the IP address to perform whitelisting? Thanks
- Labels:
-
Azure
-
Cluster
-
IP Addresses
-
Python notebook
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-21-2021 01:39 AM
- You can use pool for instances and set that there is "min idle" = "max capacity" so it will not auto terminate so ip will remain the same but this solution doesn't guarantee that it will not change (for example during upgrade or something)
- Preferred solution is when you do VM injection you can set routing and set that traffic through internet is going through firewall which have constant ip address. There is ready Azure firewall but a bit expensive, you can install own firewall on VM (there are ready images on Marketplace).
- Some other solution like connection through VPN or proxy requests are possible in some cases as alternative.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-21-2021 02:56 AM
I would not go for option 1 indeed as Hubert said.
Azure provided solutions (VNET injection etc) are preferred.
The IP range which is used for the Azure VMs (which Databricks uses) will be quite big so whitelisting that whole range defeats the use of a firewall.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2024 03:49 AM
@-werners- Do you think there is any way we can use one single ip to access our target resource from databricks? I know databricks creates/uses so many ip's which is not feasible solution to whitelist each time. Please let me know if you have any idea on it. Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2024 04:08 AM
Depends on the scenario. You could expose a single ip address to the external internet, but databricks itself will always use many addresses.