cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

git integration with volumes?

-werners-
Esteemed Contributor III

Volumes in unity are said to be ideal for "storing library and config files of arbitrary formats such as .whl or .txt centrally and providing secure access across workspaces to it".

So basically this is the same we had with dbfs but with decent access control.
But if we want to use volumes for our libraries and config files, I am missing git integration.
How do we handle automated scenarios where a git provider automatically puts updated config files in the volumes on Unity?
In dbfs we could create a pipeline in f.e. Azure devops that runs when a merge is executed on main and copies all the concerning files to dbfs.
However for Volumes it is not clear if this is possible.
Anyone an idea/experience?

1 REPLY 1

-werners-
Esteemed Contributor III

I suspected as much. Otherwise the docs would mention it.
It would be great though to have some kind of automation, especially when working with config/libs.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group