Databricks Generative AI - Large Language Models

[Adyasha]

Presentation Slides 
Serving: [Preview] Serverless GPU Generative AI Serving
🦜️🔗 LangChain w/ logging as scalable endpoints using Model Serving [docs]  
Serve FAISS, Chroma as scalable endpoint using Model Serving [Blog: Driving a Large Language Model Revolution in Customer Service and Support]
Improved credential management for calling external APIs from Model Serving [docs]
DIY: 🤗 optimizations, including from_spark(...) 40% faster data loading [Blog]
MLflow for Generative AI: Native flavors for logging for 🤗, OpenAI, 🦜️🔗 LangChain [Blog: Introducing MLflow 2.3]
Evaluation tools for LLMs [Blog: Announcing MLflow 2.4]
SQL + AI: [preview] AI Functions to use Open AI + any AI model as a SQL function [Blog: Introducing AI Functions]
Q&A chatbots w/ 🦜️🔗 LangChain → solution accelerator [ai-cookbook]
AI model discovery: Curated best-in-class Open Source Foundational Models & Task-Specific Generative AI models [ Best-in-class open source generative AI models for free commercial use]
LangChain: Native Databricks integrations for LangChain [docs]
#databricks #llm