https://community.databricks.com/t5/administration-architecture/would-it-be-great-if-the-job-workflow-supports-running-docker/m-p/83089#M1576 <P>The current workflow function in Databricks gives a series of options such as DLT, Dbt, python scripts, python files, JAR, etc. It would be good to add a docker file to that and simplify the development process a lot, especially on the unit and integration testing use side.</P><P>We might argue that the spark engine optimizes the code before the run however not every use case needs a powerful running engine such as a Spark or Spark engine could consider the docker image as a processing unit with input and output with no optimization required.</P> Thu, 15 Aug 2024 12:38:39 GMT mo_moattar 2024-08-15T12:38:39Z https://community.databricks.com/t5/administration-architecture/would-it-be-great-if-the-job-workflow-supports-running-docker/m-p/83089#M1576 <P>The current workflow function in Databricks gives a series of options such as DLT, Dbt, python scripts, python files, JAR, etc. It would be good to add a docker file to that and simplify the development process a lot, especially on the unit and integration testing use side.</P><P>We might argue that the spark engine optimizes the code before the run however not every use case needs a powerful running engine such as a Spark or Spark engine could consider the docker image as a processing unit with input and output with no optimization required.</P> Thu, 15 Aug 2024 12:38:39 GMT https://community.databricks.com/t5/administration-architecture/would-it-be-great-if-the-job-workflow-supports-running-docker/m-p/83089#M1576 mo_moattar 2024-08-15T12:38:39Z https://community.databricks.com/t5/administration-architecture/would-it-be-great-if-the-job-workflow-supports-running-docker/m-p/138205#M4429 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/114861">@mo_moattar</a>&nbsp;!</P> <P>Is this still some functionality you're interested in? If so, can you explain a bit more on the use case you're thinking? I'm happy to add this to our feature requests internally, but I know that the Product team will likely request a bit more information on what kind of functionality you're looking for here. Looking forward to your response!</P> Sat, 08 Nov 2025 06:16:46 GMT https://community.databricks.com/t5/administration-architecture/would-it-be-great-if-the-job-workflow-supports-running-docker/m-p/138205#M4429 jack_zaldivar 2025-11-08T06:16:46Z