What is the difference between full fine-tuning, LoRA, and p-tuning on Databricks?

[Suheb]

How are these three methods different?

Full Fine-Tuning
LoRA
P-Tuning

[saurabh18cs]

Hi @Suheb 

Summary Table:

Method What’s Tuned Speed/Cost Flexibility Use Case

Full Fine-Tuning	All model weights	Slow/High	Maximum	Custom tasks, large data
LoRA	Small adapter layers	Fast/Low	High	Efficient adaptation
p-tuning	Prompt embeddings	Fastest/Low	Limited	Prompt-based tasks