topic Re: Fine Tuning Dolly in Machine Learning

Fine Tuning Dolly

KevinKnights — Thu, 29 Jun 2023 20:33:24 GMT

Hi Community, could you guys share your experience fine tuning Dolly? Thanks, Kevin K.

Re: Fine Tuning Dolly

Kumaran — Mon, 10 Jul 2023 20:37:26 GMT

The below doc may help you.

https://www.databricks.com/blog/2023/03/20/fine-tuning-large-language-models-hugging-face-and-deepspeed.html

Re: Fine Tuning Dolly

GKH — Tue, 11 Jul 2023 23:05:26 GMT

I have had no experience fine tuning it. So far I've had difficulties using Dolly served as a REST endpoint.
https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/37405#M1939

Re: Fine Tuning Dolly

Anonymous — Wed, 12 Jul 2023 09:57:44 GMT

Hi @KevinKnights

Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.

Cheers!

Re: Fine Tuning Dolly

KevinKnights — Wed, 12 Jul 2023 12:21:28 GMT

Hi @Anonymous

Haven't received an answer to my question, but I'll share details about fine-tuning myself since I was able to fine tune Dolly 🙂

Regards,

Re: Fine Tuning Dolly

Kumaran — Wed, 12 Jul 2023 14:15:11 GMT

Hi @KevinKnights,

Thank you for your question in the Databricks community.

I understand that you are looking for documentation on how to fine-tune the Dolly model. Please refer to this documentation on how to fine-tune the model, and let us know if it is helpful.