Asset bundle build and deploy python wheel with versions

pablobd
Contributor II

Hi all,

I was able to deploy a wheel to the /Shared/ folder from a repository in Gitlab with asset bundles. The databricks.yml looks something like this.

artifacts:
  default:
    type: whl
    build: poetry build
    path: .
  targets:
    workspace:
      host: ***
      root_path: /Shared/.bundle/...

 

The build happens and it stores the wheel here,
 
/Shared/.bundle/library/artifacts/.internal/<hash>/<file-name>.whl
 
 
 
What I would like to have is some sort of versioning of package deployments. The problems that prevents this to happen are:
  • At each deployment the previous deployed files are removed (no versioning)
  • The path to the wheel contains a hash that keeps changing, so it's hard to point to it
 
How would you proceed?

Thanks

 

pablobd
Contributor II

Finally I decided to use AWS Code Artifact and mirror the PyPI, which I think it's a bit cleaner. But your solution looks good too. Thanks!