Re: git integration with volumes?

-werners- · ‎09-06-2023

Volumes in unity are said to be ideal for "storing library and config files of arbitrary formats such as .whl or .txt centrally and providing secure access across workspaces to it".

So basically this is the same we had with dbfs but with decent access control.
But if we want to use volumes for our libraries and config files, I am missing git integration.
How do we handle automated scenarios where a git provider automatically puts updated config files in the volumes on Unity?
In dbfs we could create a pipeline in f.e. Azure devops that runs when a merge is executed on main and copies all the concerning files to dbfs.
However for Volumes it is not clear if this is possible.
Anyone an idea/experience?

-werners- · ‎09-14-2023

I suspected as much. Otherwise the docs would mention it.
It would be great though to have some kind of automation, especially when working with config/libs.

ddundovic · ‎08-02-2025

This still doesn't seem to be possible. My current workflow for this is to add a task in my CI pipeline, where I use databricks-cli, i.e., `databricks fs cp /path/to/my/config/file dbfs:/Volume/path/to/databricks/volume` to copy my config files to the UC volume whenever they change.

Riverara · ‎08-03-2025

I totally get where you’re coming from! Managing config files with access control is crucial, but the lack of Git integration in Unity volumes can be a bit frustrating. In my experience, finding a smooth workflow can take time. I’ve found using tools like Solar Smash for quick simulations helps in environments where speed is key, but it's essential to ensure your file management system keeps up. Hopefully, there’s a solid solution on the horizon!