cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What is the difference between full fine-tuning, LoRA, and p-tuning on Databricks?

Suheb
New Contributor III

How are these three methods different?

Full Fine-Tuning
LoRA
P-Tuning

1 REPLY 1

saurabh18cs
Honored Contributor II

Hi @Suheb 

Summary Table:

Method Whatโ€™s Tuned Speed/Cost Flexibility Use Case

Full Fine-TuningAll model weightsSlow/HighMaximumCustom tasks, large data
LoRASmall adapter layersFast/LowHighEfficient adaptation
p-tuningPrompt embeddingsFastest/LowLimitedPrompt-based tasks