Hi everyone,
Our internal company security policy for the Cloud infrastructure requires to have custom outbound NSG rule that denies all traffic. The rules attributes should be as follows:
Priority: 4096
Port: Any
Protocol: Any
Source: Any
Destination: Any
Action: Deny
After creation of this rule Databricks cluster stops working - jobs are not submitted and the cell in the notebook constantly shows "Running command..."
Changing Destination to Internet does not help either.
Looks like in addition to this restriction rule some explicit permissive rules should be created.
Could you please recommend which configurations for this rules should be done or point into the manuals if such exist.
