โ07-19-2024 10:25 AM
Hi Everyone,
In my existing notebooks we have used mount points url as /mnt/ and we have more than 200 notebooks where we have used the above url to fetch the data/file from the container. Now as we are upgrading to unity catalog these url will no longer be supporting and we have to use something which start with abfss://
here my concern is I canโt go and edit each and every notebooks with new url. Is there any way to achieve this by doing minimal changes at notebook level by keeping old url which should refer to new url in unity catalog.
Thanks in advance for your time and support!!
#unitycatalog
โ08-01-2024 04:02 AM
Fine but for stg and prod url will be different right if i replace stg url in notebook and if i move it into prod then stg url will not work in prod right
โ07-26-2024 03:05 AM
@adityarai316 Can you use Volumes instead? It basically replaces the old mount approach
โ08-01-2024 04:03 AM
But in existing notebooks it is like /mnt/ so any way we have to replace this url with something else right so that it can point to new url. Volume will basically point to abfss url right ?
โ08-01-2024 05:38 AM
@adityarai316 Yes, they also point to abfss urls as well. The main and very important difference though is that volumes are "database objects", and with unity catalog in place you can put access control on that, i.e. granting read/write access to different groups/users. This is not possible to "old-school" mounts.
โ10-27-2024 10:09 PM
@adityarai316 did u get the solution because I am facing the same issue?
Sunday
yes, we have stored old mount point and new url in form of key-value pair at the cluster level and defined it as a global variable. Post that we have used it in our custom notebook by importing os cmd and the variable. This way you will be able to tackle it.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group