What is the difference between full fine-tuning, LoRA, and p-tuning on Databricks?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
How are these three methods different?
Full Fine-Tuning
LoRA
P-Tuning
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
Hi @Suheb
Summary Table:
Method What’s Tuned Speed/Cost Flexibility Use Case
| Full Fine-Tuning | All model weights | Slow/High | Maximum | Custom tasks, large data |
| LoRA | Small adapter layers | Fast/Low | High | Efficient adaptation |
| p-tuning | Prompt embeddings | Fastest/Low | Limited | Prompt-based tasks |
