I have a job that's running some ML classification models. This uses PyTorch 2.5.0. I've configured the project with that dependency.
I can deploy my job to our dev system from my laptop and all goes well. When I run this off our CI/CD server, for some reason it wants to upload dependencies when it runs databricks bundle deploy, it appears to try to upload the dependencies and fails on the PyTorch wheel which is apparently huge.
I shouldn't need to upload dependencies with the DAB, why is it trying to deploy them? Running off my laptop, it doesn't try to upload the dependencies and the deploy is done in a few seconds.