Asset bundle build and deploy python wheel with versions

pablobd — Thu, 14 Dec 2023 17:16:55 GMT

Hi all,

I was able to deploy a wheel to the /Shared/ folder from a repository in Gitlab with asset bundles. The databricks.yml looks something like this.

artifacts:
default:
type: whl
build: poetry build
path: .
targets:
workspace:
host: ***
root_path: /Shared/.bundle/...

The build happens and it stores the wheel here,

/Shared/.bundle/library/artifacts/.internal/<hash>/<file-name>.whl

What I would like to have is some sort of versioning of package deployments. The problems that prevents this to happen are:

At each deployment the previous deployed files are removed (no versioning)
The path to the wheel contains a hash that keeps changing, so it's hard to point to it

How would you proceed?

Thanks

Re: Asset bundle build and deploy python wheel with versions

pablobd — Fri, 15 Dec 2023 09:51:22 GMT

Finally I decided to use AWS Code Artifact and mirror the PyPI, which I think it's a bit cleaner. But your solution looks good too. Thanks!

topic Asset bundle build and deploy python wheel with versions in Get Started Discussions

Asset bundle build and deploy python wheel with versions

Re: Asset bundle build and deploy python wheel with versions