We have problem with import any python files as module on VNET injected workspace.
- For same folder structure (see bellow), the imports works on serverless clusters or in databricks managed workspace (i.e. create new azure databricks workspace without networking), but not in VNET injected workspace.
- no firewall (we dont have hub-spoke architecture), only NSG, NAT and public dns zones (privatelink.azuredatabricks.net, privatelink.dfs.core.windows.net)
- NSG rules:
- NSG rules:
- no firewall (we dont have hub-spoke architecture), only NSG, NAT and public dns zones (privatelink.azuredatabricks.net, privatelink.dfs.core.windows.net)
- workspace netowrking setting (SCC enables, public access enabled, no azure datbairkcs rules)+ PE to back-end connectivity
- Once we create any kind of cluster (unrestricted, shared, personal or job) the import issue arise. Tested with runtimes 17.4 and 16.4.
- Py files appears to be visible but empty from the cluster perspective. (we alsp see errno 5 file exists issues
- %run works for notebook but cant import func between notebooksTrivial import test:
On serverless (OK):
Any idea what to check or might be missing? I suspect some networking missconfiguration but cant find potentials issue.
