When using your own docker container while creating a databricks cluster, what is the mapping between the number of containers launched and the nodes launched?
Is it 1:1 mapping? or is it similar to other orchestration framework like Kubernetes?
Or is it node based? like driver node has a different mapping compared to worker nodes?
In documentation it says, internally databricks container service is used to launch docker container, but we do not get a clear picture as to how the orchestration is done.
I need to understand this underlying orchestration, as I have a use case where I need to run a service within a container only on the driver node and not on the worker nodes & need to endure that only one such container is running on the driver node.
