Does Databricks support GPU model inference?

[Nihit]

Can I deploy a model online with GPU inference support?

[Kaniz_Fatma]

Hi @Nihit D​, Databricks supports clusters accelerated with graphics processing units (GPUs). This article describes how to create clusters with GPU-enabled instances and describes the GPU drivers and libraries installed on those instances.

To learn more about deep learning on GPU-enabled clusters, see Deep learning.

[jose_gonzalez]

Hi @Nihit D​,

Just a friendly follow-up. Did Kaniz's response helped you or do you still need help? please let us know.