Asset bundle build and deploy python wheel with versions
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2023 09:16 AM
Hi all,
I was able to deploy a wheel to the /Shared/ folder from a repository in Gitlab with asset bundles. The databricks.yml looks something like this.
artifacts:
default:
type: whl
build: poetry build
path: .
targets:
workspace:
host: ***
root_path: /Shared/.bundle/...
The build happens and it stores the wheel here,
/Shared/.bundle/library/artifacts/.internal/<hash>/<file-name>.whl
What I would like to have is some sort of versioning of package deployments. The problems that prevents this to happen are:
- At each deployment the previous deployed files are removed (no versioning)
- The path to the wheel contains a hash that keeps changing, so it's hard to point to it
How would you proceed?
Thanks
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2023 01:51 AM
Finally I decided to use AWS Code Artifact and mirror the PyPI, which I think it's a bit cleaner. But your solution looks good too. Thanks!