How to create a docker image to deploy and run in different environments in databricks?

[vemash]

I am new to databricks, and trying to implement below task.

Task:
Once code merges to main branch and build is successful  CI pipeline and all tests are passed, docker build should start and create a docker image and push to different environments (from dev to stage, and prod) Artifactory.

How can I start this setup? Any guidance is appreciated. Thank you!

[MichTalebzadeh]

Hi,

This is no different for building docker image for various environments

Let us try a simple high level CI/CD pipeline for building Docker images and deploying them to different environments:. It works in all environments including Databricks

             +------------------+
             |    Main Branch   |
             +------------------+
                      |
                      V
               +--------------+
               |   CI Server  |
               +--------------+
                      |
                      V
              +---------------+
              |   Check out   |
              +---------------+
                      |
                      V
              +---------------+
              |    Build      |
              +---------------+
                      |
                      V
              +---------------+
              |    Test       |
              +---------------+
                      |
                      V
              +---------------+
              | Docker Build  |
              +---------------+
                      |
                      V
              +---------------+
              | Push to       |
              | Container     |
              |   Registry    |
              +---------------+
                      |
                      V
           +---------------------+
           | Deploy to Dev       |
           | Deploy to Stage     |
           | Deploy to Prod      |
           +---------------------+

    Steps (basics)

1. Code changes are made and pushed to the main branch.
2. The CI server triggers a pipeline.
3. The pipeline chec ks out the code from the main/master branch.
4. The code is built.
5. Tests are run.
6. Docker  images are built.
7. Docker images are pushed to a Container registry.
8. Deployments are made to the development, staging, and production environments.

HTH