How to make terminal available when starting a cluster with a docker image?

[francescocamuss]

Hello everybody, I'm starting a cluster with a docker image because I my team use a lot of R libraries that would be time consuming to install them on a init script.

 The thing is that the cluster starts ok, but I can't acces to the cluster terminal as I can do with my other cluster that don't use any docker image.

 Is there a solution for this?

[Kaniz]

Hi @ francescocamussoni,

Here's the documentation.

Please have a look.

https://docs.databricks.com/clusters/custom-containers.html

[francescocamuss]

Yes, I've read that post but it doesn't specify anything about the cluster terminal or does it?

[Prabakar]

@Francesco Camussoni​  are you using databricksruntime/rbase as your base image?

[francescocamuss]

Exactly rbase:8.x with runtime 8.3, for example. and I added the init script.

[Kaniz · Accepted solution]

Hi @Francesco Camussoni​ , This is one of the limitations of DBR.

Limitations of DBR:-

• Azure Databricks does not support running Spark jobs from the web terminal. In addition, the Azure Databricks web terminal is not available in the following cluster types:
  • Job clusters
  • High concurrency clusters with either table access control or credential passthrough enabled.
• Clusters launched with the DISABLE_WEB_TERMINAL=true environment variable set.

• Enabling Docker Container Services disables web terminal.

Source