How to do cicd with different models/versions using databricks resources?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-11-2024 04:08 PM
Generally speaking what are the tips to make cicd process better with having different versions and models?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-20-2024 08:44 AM
Hi @Betul, I think that there are different ways but it really depends on what do you mean by different models and versions.
One simple option is to use Databricks Asset Bundles to create multiple workflows (one for each model) and use the champion-challenger approach to make sure that your new model version is only deployed if it beats the current deployed version. The workflows can be run in parallel (if you're using Github actions you can employ a matrix workload for that).
If you elaborate mode on your use case I can try to help you further.