Hi,
I have a solution design question on which I am looking for some help. We have 2 environments in azure (dev and prod), each env has its own ADLS storage account with a different name of course.
Within Databricks code we are NOT leveraging the mount point rather opted for the table ACL clusters with a service principal attached and all tables are created as unmanaged tables with data stored in ADLS. Problem is that when referencing/creating these tables we have to specify the full file path `abfss://<container_name>@<storage_account_name>...`. Previously with a mount point we would just use `/mnt/<mount-point-name>/...`
Since the storage account name is different between dev and prod we can't promote the code as is and ideally we don't wan't to parametrize the storage account every where it has to be referenced. Is there a better/smarter way to handle this problem?
Looking forward to hear from the community
Thanks!