cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

DAB - All projects files deployed

cmathieu
New Contributor III

I have an issue with DAB where all the project files, starting from root ., get deployed to the /files folder in the bundle. 

I would prefer being able to deploy certain util notebooks, but not all the files of the project. 

I'm able to not deploy any files by adding a wildcard to the sync - exclude in the databricks.yml, but it stops me from selectively add files in the sync - include. 

4 REPLIES 4

ashraf1395
Honored Contributor

Hi there @cmathieu ,

You can use sync  -paths to specify the files you want to deploy in the files folders instead of all using the include or exclude folder. -paths works better for me I can use it to deploy any files in my local to workspace even outside my bundle dir just need to use correct path relative to my databricks.yml

Here are the docs: https://docs.databricks.com/aws/en/dev-tools/bundles/settings#paths

cmathieu
New Contributor III

Thanks for this hint. My goal is to deploy a whole directory, but not any others.

ashraf1395
Honored Contributor

@cmathieu , It will support  deployment of whole directory and not others as well.

cmathieu
New Contributor III

I tried it and it's the same behaviour as sync-include. As long as all files are excluded, no files can be included in the sync-include or sync-files. Not sure who to approach this without having to list all folders and files to exclude. 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now