The Spark driver / executors have callbacks to an external service. I need to find out the IP ranges to be locked down for the firewall on the external service.
Here is what I found from Azure (https://www.microsoft.com/en-us/download/details.aspx?id=5651), but the IP ranges listed seem to be related to the Databricks system services:
{
"name": "AzureDatabricks",
"id": "AzureDatabricks",
"properties": {
"changeNumber": 11,
"region": "",
"regionId": 0,
"platform": "Azure",
"systemService": "AzureDatabricks",
"addressPrefixes": [
"13.70.105.50/32",
"13.70.107.141/32",
"13.71.184.74/32",
...
