Custom deployment of LLM model in Databricks

[BR_DatabricksAI]

Can we deploy our own Custom LLM model in Databricks? If anyone has any material or link, please share with me. 

[Kaniz]

Hi @BR_DatabricksAI, Yes, you can deploy your own custom Large Language Model (LLM) in Databricks. 

Here are some key points:

Databricks Model Serving: Databricks Model Serving supports the deployment of open-source or your ow.... It automatically optimizes your model for LLM Serving, providing best-in-class performance with zero....

Libraries: Databricks Runtime for Machine Learning includes libraries like Hugging Face Transformers....

Custom Libraries: Databricks offers native support for the installation of custom libraries and libr....

Fine-tuning: You can leverage Databricks platform capabilities to fine-tune LLMs using your own data....

Deployment: All it takes to deploy your fine-tuned model is to create a Serving Endpoint and include....

For more detailed information, you can refer to the official Databricks documentation. 

[BR_DatabricksAI]

Hello Kaniz, 

Thanks for sharing the link, I will go through these and will come back if any further help needed. 

Regards

Bhupendra