https://community.databricks.com/t5/get-started-discussions/container-lifetime/m-p/110147#M9822 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/142679">@mrstevegross</a>&nbsp;</P> <DIV class="lzjgu3f"> <DIV class="lzjgu33"> <DIV class="lzjgu3g lzjgu35"> <DIV class="lzjgu3j lzjgu3l"> <DIV class="_1poi13f0 _1azxaep2" tabindex="0"> <DIV class="_1poi13f3"> <DIV> <OL> <LI><STRONG>Cluster Creation</STRONG>: When you submit a job using the "Create and trigger a one-time run" API, a new cluster is created if one is not specified.</LI> <LI><STRONG>Container Start</STRONG>: The custom Docker image specified in the cluster configuration is used to start the container.</LI> <LI><STRONG>Job Execution</STRONG>: The job runs within this container.</LI> <LI><STRONG>Container Termination</STRONG>: After the job completes, the container is terminated along with the cluster.</LI> </OL> <P class="_1t7bu9h1 paragraph">The container does not persist and is not reused by subsequent jobs. Each job submission that requires a new cluster will start a new container based on the specified custom image, run the job, and then terminate the container and cluster upon completion.</P> </DIV> </DIV> </DIV> </DIV> </DIV> </DIV> </DIV> Thu, 13 Feb 2025 20:35:21 GMT Alberto_Umana 2025-02-13T20:35:21Z https://community.databricks.com/t5/get-started-discussions/container-lifetime/m-p/110144#M9821 <P>When launching a job via "Create and trigger a one-time run" (<A href="https://docs.databricks.com/api/workspace/jobs_21/submit" target="_self">docs)</A>, when using a custom image (<A href="https://docs.databricks.com/api/workspace/clusters/create#docker_image" target="_self">docs</A>), what's the lifetime of the container? Does it create the cluster, start the container, run the job, then terminate the container? Or does the running container persist and get re-used by subsequent jobs?</P> Thu, 13 Feb 2025 18:02:54 GMT https://community.databricks.com/t5/get-started-discussions/container-lifetime/m-p/110144#M9821 mrstevegross 2025-02-13T18:02:54Z https://community.databricks.com/t5/get-started-discussions/container-lifetime/m-p/110147#M9822 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/142679">@mrstevegross</a>&nbsp;</P> <DIV class="lzjgu3f"> <DIV class="lzjgu33"> <DIV class="lzjgu3g lzjgu35"> <DIV class="lzjgu3j lzjgu3l"> <DIV class="_1poi13f0 _1azxaep2" tabindex="0"> <DIV class="_1poi13f3"> <DIV> <OL> <LI><STRONG>Cluster Creation</STRONG>: When you submit a job using the "Create and trigger a one-time run" API, a new cluster is created if one is not specified.</LI> <LI><STRONG>Container Start</STRONG>: The custom Docker image specified in the cluster configuration is used to start the container.</LI> <LI><STRONG>Job Execution</STRONG>: The job runs within this container.</LI> <LI><STRONG>Container Termination</STRONG>: After the job completes, the container is terminated along with the cluster.</LI> </OL> <P class="_1t7bu9h1 paragraph">The container does not persist and is not reused by subsequent jobs. Each job submission that requires a new cluster will start a new container based on the specified custom image, run the job, and then terminate the container and cluster upon completion.</P> </DIV> </DIV> </DIV> </DIV> </DIV> </DIV> </DIV> Thu, 13 Feb 2025 20:35:21 GMT https://community.databricks.com/t5/get-started-discussions/container-lifetime/m-p/110147#M9822 Alberto_Umana 2025-02-13T20:35:21Z