- 2354 Views
- 1 replies
- 1 kudos
Ganglia not working with custom container services
Setup:custom docker container starting from the "databricksruntime/gpu-conda:cuda11" base image layer10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12)multi-node, p3.8xlarge GPU computeWhen I try to view Ganglia metrics I am met with "502 Bad Gatewa...
- 2354 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @James W​ , Ganglia is not available for custom docker containers by default. This is a known limitation. However, you can try this experimental support for ganglia in custom DCS:https://github.com/databricks/containers/tree/master/experimental/ub...
- 1 kudos
- 2577 Views
- 3 replies
- 2 kudos
Resolved! Cannot use Web Terminal when creating cluster with Custom container.
I follow this guide to create cluster with custom container: https://docs.databricks.com/clusters/custom-containers.htmlHowever, when cluster created, I coudn't access to web terminal. It resulted in 502 bad gateway.
- 2577 Views
- 3 replies
- 2 kudos
- 2 kudos
This is a limitation at the moment. Enabling Docker Container Services disables web terminal.https://docs.databricks.com/clusters/web-terminal.html#limitations
- 2 kudos