Azure Databricks Capabilities: My objective is to evaluate Azure Databricks capability and Do I need to use Azure Devops or Jenkins or Databricks suffice the need.

Saurabh707344
Databricks Partner

hi,

We have Real time streaming usecase where we have to build pipeline using Azure Databricks.

My objective is to evaluate Azure Databricks capability and Do I need to use Azure Devops or Jenkins or Databricks suffice the need.

Can you please provide clarity around few of the below questions around Databricks MLOps :-

Q1. In case i use GIT repos instead of Databricks repos, does it create any conflict when I have usecase of realtime streaming in production ?

In other words Does external tools like GIT provide seamless experience when we have realtime streaming scenarios ?

Q2. Jenkins Or Azure devops service need to be used for build and rest part of automated CI/CD pipelines OR

Does Databricks suffice need of automated pipeline of code ?

Thanks,

Saurabh