cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Docker tab missing in create compute

Askenm
New Contributor

I am running databricks premium and looking to create a compute running conda. It seems that the best way to do this is to boot the compute from a docker image. However, in the ```create_compute > advanced``` I cannot see the the docker option nor can i see it in other tabs in the create compute. 

Am i missing permissions or shoud i alter some underlying configuration? 

4 REPLIES 4

Advika
Databricks Employee
Databricks Employee

Hello @Askenm!

Have you enabled Databricks Container Services in your workspace settings?
Without enabling DCS, the Docker option won’t appear when you create a compute cluster.

For reference: https://docs.databricks.com/aws/en/compute/custom-containers

NandiniN
Databricks Employee
Databricks Employee

Advika is correct, atabricks Container Services needs to be explicitly enabled for your workspace.

A workspace admin can enable it using the Databricks CLI with the following command:

databricks workspace-conf set-status \ --json '{"enableDcs": "true"}'

Refer - https://docs.databricks.com/aws/en/compute/custom-containers#enable

Wull
Visitor

@NandiniN @Advika I've followed the documentation and enabled DCS by using the Databricks CLI and running

databricks workspace-conf set-status \ --json '{"enableDcs": "true"}'

I even checked by running get-status.

However, one month later, and the Docker tab is still not showing up in the Advanced section of the Create Compute page. I tried setting the Access Mode to Dedicated: Single User, and still not showing. I tried No User Isolation, and that doesn't work either.

 

I am using SINGLE_USER access mode and Databricks Runtime 16.4 LTS on GCP, but I do not see the Docker tab for custom containers. Is Databricks Container Services enabled for my workspace, and is there any tier or backend restriction?