The Spark driver / executors have callbacks to an external service. I need to find out the IP ranges to be locked down for the firewall on the external service.

Here is what I found from Azure (https://www.microsoft.com/en-us/download/details.aspx?id=5651), but the IP ranges listed seem to be related to the Databricks system services:

{

"name": "AzureDatabricks",

"id": "AzureDatabricks",

"properties": {

"changeNumber": 11,

"region": "",

"regionId": 0,

"platform": "Azure",

"systemService": "AzureDatabricks",

"addressPrefixes": [

"13.70.105.50/32",

"13.70.107.141/32",

"13.71.184.74/32",

...