- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-05-2026 10:48 PM
Hi @jayshan, you're right the material is outdated now. The more current path is Foundation Model Fine-tuning, which is part of Mosaic AI Model Training. You can run it from the Databricks UI or with the databricks_genai SDK, point it at training data in Unity Catalog, pick a task type like CHAT_COMPLETION, INSTRUCTION_FINETUNE, or CONTINUED_PRETRAIN, and it will register the fine-tuned model back to Unity Catalog for serving. Just note it's still in Public Preview and limited to certain regions. Here is the official doc: https://docs.databricks.com/aws/en/large-language-models/foundation-model-training/
If you need more control than the managed API offers, you can also spin up a GPU cluster on Databricks AI Runtime and use libraries like LoRA, TRL, DeepSpeed, Unsloth, or Axolotl for custom workflows