Kumaran
Databricks Employee
Databricks Employee

Hi @gary7135,

Thank you for posting the question in the Databricks community.

Kindly update the configuration by setting fp16=True instead of its current value of false. For further information regarding the CUDA error related to this, please refer to this documentation