Hello,
I have a question about DNS addresses Databricks uses.
In our network configuration, we are using custom VNet injection with no public IPs, and are required to use on-premises corporate DNS.
Therefore we would like to add necessary entries to on-prem DNS - but are not sure which exactly addresses Databricks workspace uses.
Without explicit DNS configuration, clusters fails to start - with "Timeout placing nodes" error.
VMs are created in Azure, so obviously the issue is that head node cannot communicate with workers, as it's not able to resolve DNS.