Fine Tuning Dolly

[KevinKnights]

Hi Community, could you guys share your experience fine tuning Dolly? Thanks, Kevin K.

[Kumaran]

The below doc may help you.

https://www.databricks.com/blog/2023/03/20/fine-tuning-large-language-models-hugging-face-and-deepsp...

[GKH]

I have had no experience fine tuning it. So far I've had difficulties using Dolly served as a REST endpoint.
https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/3...

[Anonymous]

Hi @KevinKnights 

Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.

Cheers!

[KevinKnights]

Hi @Anonymous 

Haven't received an answer to my question, but I'll share details about fine-tuning myself since I was able to fine tune Dolly 🙂

Regards,

[Kumaran]

Hi @KevinKnights,

Thank you for your question in the Databricks community.

I understand that you are looking for documentation on how to fine-tune the Dolly model. Please refer to this documentation on how to fine-tune the model, and let us know if it is helpful.