topic Data+AI Summit 2024 GenAI & ML Announcements in Announcements

topic Data+AI Summit 2024 GenAI & ML Announcements in Announcements https://community.databricks.com/t5/announcements/data-ai-summit-2024-genai-amp-ml-announcements/m-p/78367#M218 <H1 id="f82e" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">In a nutshell — it’s all about Compound AI Systems</H1> <P class="pw-post-body-paragraph la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx fi bj" data-selectable-paragraph="">Watch this video for a deep dive into all the GenAI and ML announcements, and read the newsletter below for more details!</P> <FIGURE class="nc nd ne nf ng nh"> <DIV class="ni nj l ec"> <DIV class="nk nl l"><IFRAME src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FXKxf9zE-0Is%3Ffeature%3Doembed&display_name=YouTube&url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DXKxf9zE-0Is&image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FXKxf9zE-0Is%2Fhqdefault.jpg&key=a19fcc184b9711e1b4764040d3dc5c07&type=text%2Fhtml&schema=youtube" width="854" height="480" frameborder="0" scrolling="no" allowfullscreen="" class="el n fd dy bg" title="Vector Lab - June ML & GenAI Announcements"></IFRAME></DIV> </DIV> </FIGURE> <P class="pw-post-body-paragraph la lb fp lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fi bj" data-selectable-paragraph="">Here are the main takeaways in the Machine Learning and GenAI space:</P> <UL class=""> <LI id="8f8d" class="la lb fp lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/47025462-16d9-475f-adb7-7008f8fbe144?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow"><STRONG class="lc fq">Mosaic AI: Build and deploy production-quality Compound AI Systems</STRONG></A><STRONG class="lc fq">:<SPAN> </SPAN></STRONG>The evolution of monolithic AI models to compound systems is an active area of both academic and industry research.</LI> <LI id="2fdc" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch the Data+AI summit keynote<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/597db0cd-54b0-4d2a-a48b-c40c332bb59b?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">recording</A><SPAN> </SPAN>to get an overview on how to build production-quality AI systems.</LI> <LI id="5b98" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch this<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/72f3a268-34a9-46b6-a5b1-3bd5dc87a2b0?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">video</A><SPAN> </SPAN>on how to optimize LLM pipelines with DSPy and to learn more about compound systems.</LI> </UL> <H1 id="6f69" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph=""><STRONG class="al">Mosaic AI Model Training</STRONG></H1> <UL class=""> <LI id="c4d3" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Model Training</STRONG><SPAN> </SPAN>(fka. “Finetuning” and “Foundation Model Training”) is in public preview: it allows you to fine-tune open source foundation models with your private data, giving it new knowledge that is specific to a particular domain or task. Once the model is trained, you own the weights and the data, and we make it easy to serve through Provisioned Throughput by automatically registering it to your Unity Catalog. With this release, we have expanded availability to most US regions in<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/f58958ad-32c6-4ddb-811a-1aef8fb352d3?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">AWS</A><SPAN> </SPAN>and<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/dd3dea82-a219-4f27-857e-63685195f723?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Azure</A>. It supports both supervised fine-tuning and continued pretraining on a list of models.</LI> <LI id="8653" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/98f828c5-706f-4400-84fa-1f235dff7181?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo video</A><SPAN> </SPAN>below, a step-by-step tutorial on how to use Mosaic AI Model Training and this<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/ad8e4383-d9ef-4bf9-9e8b-bf3cad1a0339?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">video</A><SPAN> </SPAN>on the benefits of fine-tuning an LLM.</LI> <LI id="d7ce" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Download the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/7a61f9c7-87fd-4736-8c31-6ee088eff041?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo notebooks</A><SPAN> </SPAN>to get started with fine-tuning your LLM on Databricks</LI> </UL> <FIGURE class="nc nd ne nf ng nh"> <DIV class="ni nj l ec"> <DIV class="nk nl l"><IFRAME src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2Fdmmw8mbBo6g%3Ffeature%3Doembed&display_name=YouTube&url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3Ddmmw8mbBo6g&image=https%3A%2F%2Fi.ytimg.com%2Fvi%2Fdmmw8mbBo6g%2Fhqdefault.jpg&key=a19fcc184b9711e1b4764040d3dc5c07&type=text%2Fhtml&schema=youtube" width="854" height="480" frameborder="0" scrolling="no" allowfullscreen="" class="el n fd dy bg" title="Vector Lab - Model Training with Databricks API - Step-by-Step Tutorial (With DEMO!)"></IFRAME></DIV> </DIV> </FIGURE> <FIGURE class="nc nd ne nf ng nh nu nv paragraph-image"> <DIV class="nx ny ec nz bg oa" tabindex="0" role="button"> <DIV class="nu nv nw"><PICTURE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/0*FPXidwNrJJqEn-nx.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/0*FPXidwNrJJqEn-nx.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/0*FPXidwNrJJqEn-nx.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/0*FPXidwNrJJqEn-nx.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/0*FPXidwNrJJqEn-nx.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/0*FPXidwNrJJqEn-nx.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/0*FPXidwNrJJqEn-nx.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"></SOURCE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/0*FPXidwNrJJqEn-nx.png 640w, https://miro.medium.com/v2/resize:fit:720/0*FPXidwNrJJqEn-nx.png 720w, https://miro.medium.com/v2/resize:fit:750/0*FPXidwNrJJqEn-nx.png 750w, https://miro.medium.com/v2/resize:fit:786/0*FPXidwNrJJqEn-nx.png 786w, https://miro.medium.com/v2/resize:fit:828/0*FPXidwNrJJqEn-nx.png 828w, https://miro.medium.com/v2/resize:fit:1100/0*FPXidwNrJJqEn-nx.png 1100w, https://miro.medium.com/v2/resize:fit:1400/0*FPXidwNrJJqEn-nx.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px" data-testid="og"></SOURCE></PICTURE><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="lara_rachidi_11-1720711047803.jpeg" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9491iEEA91AC0840338D9/image-size/medium?v=v2&px=400" role="button" title="lara_rachidi_11-1720711047803.jpeg" alt="lara_rachidi_11-1720711047803.jpeg" /></span> <P> </P> </DIV> </DIV> </FIGURE> <H1 id="1cbc" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Mosaic AI Agent Framework</H1> <UL class=""> <LI id="67fa" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Agent Framework<SPAN> </SPAN></STRONG>is in public preview (see<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/b8592388-2b6d-4d5e-9531-530bf7affaea?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">documentation</A><span class="lia-unicode-emoji" title=":disappointed_face:">😞</span> It’s a set of tools on Databricks designed to help developers build, deploy, and evaluate production-quality agents. This framework allows you to build an AI system that is safely governed and managed in Unity Catalog. Here is how you can build an agent:</LI> <LI id="5d43" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/759e2e85-4a2b-4efe-aef9-a9897f86f82a?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow"><STRONG class="lc fq">Create and log agents</STRONG></A><STRONG class="lc fq"><SPAN> </SPAN>using any library and MLflow.<SPAN> </SPAN></STRONG>Parameterize your agents to experiment and iterate on agent development quickly. You can set up configuration files that let you change code parameters in a traceable way without having to modify the actual code.</LI> <LI id="66a1" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/ff6ecddf-84e7-4885-804d-b3cfcc78fb54?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow"><STRONG class="lc fq">Deploy agents</STRONG></A><STRONG class="lc fq"><SPAN> </SPAN>to production</STRONG><SPAN> </SPAN>with native support for token streaming and request/response logging, plus a built-in review app to get user feedback for your agent. You can deploy agents either by using<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/c8db8f68-d332-4cfb-9825-9f28b58af905?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Model Serving</A><SPAN> </SPAN>or using the deploy() API from databricks.agents.</LI> <LI id="12e4" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/a9ab7f2a-beb6-4d1a-9963-5c0bcc652555?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow"><STRONG class="lc fq">Agent tracing</STRONG></A><SPAN> </SPAN>lets you log, analyze, and compare traces across your agent code to debug and understand how your agent responds to requests. You can add traces to your agents using the Fluent and MLflowClient APIs made available with<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/cd56cfba-573f-4047-acdc-1af380a4f22f?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">MLflow Tracing</A>.</LI> <LI id="044f" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/76bca6ec-8210-4832-b98b-ebca29f818ad?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Download the demo notebooks</A><SPAN> </SPAN>to start building a RAG app with Mosaic AI Agent Framework and Agent Evaluation, Model Serving, and Vector Search</LI> <LI id="c90d" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch this end-to-end<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/bcefeb27-b74b-48e2-94ee-e16c4b9fe209?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo video</A><SPAN> </SPAN>on how to log, deploy, and debug agents (with demo!)</LI> </UL> <FIGURE class="nc nd ne nf ng nh"> <DIV class="ni nj l ec"> <DIV class="nk nl l"><IFRAME src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2Fs62-Wr6mmLE%3Fstart%3D1%26feature%3Doembed%26start%3D1&display_name=YouTube&url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3Ds62-Wr6mmLE&image=https%3A%2F%2Fi.ytimg.com%2Fvi%2Fs62-Wr6mmLE%2Fhqdefault.jpg&key=a19fcc184b9711e1b4764040d3dc5c07&type=text%2Fhtml&schema=youtube" width="854" height="480" frameborder="0" scrolling="no" allowfullscreen="" class="el n fd dy bg" title="Vector Lab - Agents and Chains: How to Log, Deploy, and Debug AGENTS with Databricks (With demo!)"></IFRAME></DIV> </DIV> </FIGURE> <H1 id="35d6" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Foundation Model API</H1> <UL class=""> <LI id="879b" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Foundation Model API generally available</STRONG>: Foundation models are accessible as pay-per-token as well as provisioned throughput for production workloads.</LI> </UL> <H1 id="4b9b" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Mosaic AI Vector Search</H1> <UL class=""> <LI id="af28" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Vector Search now supports Customer Managed Keys and Hybrid Search (GA)</STRONG>: Databricks Vector Search is now generally available (see the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/3c6f01de-6c65-4779-818a-6076eed9c23c?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">blog post</A><SPAN> </SPAN>and<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/c9d74678-6686-476e-b937-d0f345b897bb?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">documentation</A>). New capabilities were added:<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/e9936d69-6992-42d4-9541-3fe15acc6cdd?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">PrivateLink</A><SPAN> </SPAN>and<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/45f03560-6040-4116-808c-ae932574503e?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">IP access lists</A><SPAN> </SPAN>are now supported.<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/0cdc06bb-947d-413d-b000-02b9d5dbcc42?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Customer Managed Keys</A><SPAN> </SPAN>(CMK) are also now supported on endpoints created on or after May 8, 2024. Vector Search support for CMK is in Public Preview. You can now save generated embeddings as a Delta table (see<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/cf478d4f-ddb3-4bf6-90ff-b3097d095ea9?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Create a vector search index</A>). Additionally, Vector Search now supports GTE-large embedding model, which has good retrieval performance and supports 8K context window. It also includes<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/a30fa6f7-6622-4bea-8b60-165a6a497a65?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">improved audit logs</A><SPAN> </SPAN>and cost attribution tracking.</LI> <LI id="2db8" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch this<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/3cf0eff4-a9fe-4533-a110-46615f2a4213?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">video</A><SPAN> </SPAN>(including demo) for a deep dive into Vector search</LI> </UL> <H1 id="be27" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Mosaic AI Tool Catalog and Function-Calling</H1> <UL class=""> <LI id="4859" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Tool Catalog and Function-Calling</STRONG><SPAN> </SPAN>is in public preview: Mosaic AI Tool Catalog allows you to create an enterprise registry of common functions, internal or external, and share these tools across your organization for use in AI applications. Tools can be SQL functions, Python functions, model endpoints, remote functions, or retrievers. These functions can define tasks or tools within compound AI systems. We’ve also enhanced Model Serving to natively support function-calling, so that you can use popular open source models like Llama 3–70B as your agent’s reasoning engine.</LI> <LI id="13fd" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Check the documentation<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/90ac1bb8-c468-4c3a-b595-b801b0041ba1?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">here</A><SPAN> </SPAN>and<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/839b2045-7a38-4e24-a421-0262976f903d?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">here</A><SPAN> </SPAN>to get started using function calling.</LI> <LI id="7299" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/fa8cf1f2-caeb-4d1b-adcf-f4645d9d8dc4?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo</A><SPAN> </SPAN>from the Data+AI summit showcasing this capability</LI> <LI id="dfda" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Download this<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/34c3464e-5cff-4eae-9bb5-4e233d5d65bc?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo notebook</A></LI> </UL> <FIGURE class="nc nd ne nf ng nh nu nv paragraph-image"> <DIV class="nx ny ec nz bg oa" tabindex="0" role="button"> <DIV class="nu nv oc"><PICTURE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/0*cdBd1zmxDfYOwI92.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/0*cdBd1zmxDfYOwI92.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/0*cdBd1zmxDfYOwI92.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/0*cdBd1zmxDfYOwI92.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/0*cdBd1zmxDfYOwI92.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/0*cdBd1zmxDfYOwI92.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/0*cdBd1zmxDfYOwI92.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"></SOURCE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/0*cdBd1zmxDfYOwI92.png 640w, https://miro.medium.com/v2/resize:fit:720/0*cdBd1zmxDfYOwI92.png 720w, https://miro.medium.com/v2/resize:fit:750/0*cdBd1zmxDfYOwI92.png 750w, https://miro.medium.com/v2/resize:fit:786/0*cdBd1zmxDfYOwI92.png 786w, https://miro.medium.com/v2/resize:fit:828/0*cdBd1zmxDfYOwI92.png 828w, https://miro.medium.com/v2/resize:fit:1100/0*cdBd1zmxDfYOwI92.png 1100w, https://miro.medium.com/v2/resize:fit:1400/0*cdBd1zmxDfYOwI92.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px" data-testid="og"></SOURCE></PICTURE><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="lara_rachidi_12-1720711047804.jpeg" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9490i7C55268E6E3A916F/image-size/medium?v=v2&px=400" role="button" title="lara_rachidi_12-1720711047804.jpeg" alt="lara_rachidi_12-1720711047804.jpeg" /></span> <P> </P> </DIV> </DIV> </FIGURE> <H1 id="c151" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Shutterstock ImageAI</H1> <UL class=""> <LI id="b197" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Shutterstock ImageAI</STRONG>, powered by Databricks is a new text-to-image diffusion model built using the advanced capabilities of Databricks Mosaic AI and trained exclusively on Shutterstock’s proprietary image repository.</LI> <LI id="6e14" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Blog post:<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/2ffb6790-cf5d-4a39-8e73-4912449059a7?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Shutterstock’s content Datasets are now on Databricks Marketplace</A>.</LI> </UL> <H1 id="88de" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Mosaic AI Agent Evaluation</H1> <UL class=""> <LI id="53bf" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Agent Evaluation for Automated and Human Assessments</STRONG><SPAN> </SPAN>is in public preview: it is an AI-assisted evaluation tool that automatically determines if outputs are high-quality and provides an intuitive UI to get feedback from human stakeholders. Agent Evaluation lets you define what high-quality answers look like for your AI system by providing “golden” examples of successful interactions. You can explore permutations of the system, tuning models, changing retrieval, or adding tools, and understand how system changes alter quality. Agent Evaluation also lets you invite subject matter experts across your organization — even those without Databricks accounts — to review and label your AI system output to do production quality assessments and build up an extended evaluation dataset. Finally, system-provided LLM judges can further scale the collection of evaluation data by grading responses on common criteria such as accuracy or helpfulness. Detailed production traces can help diagnose low-quality responses.</LI> <LI id="0bb9" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/e3865858-be62-478b-a846-e6200041ead8?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo</A><SPAN> </SPAN>from the Data+AI summit showcasing this capability.</LI> <LI id="2235" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">This feature is also explained in the end-to-end<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/bcefeb27-b74b-48e2-94ee-e16c4b9fe209?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo video</A><SPAN> </SPAN>mentioned above on how to log, deploy, and debug agents.</LI> <LI id="9a36" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Documentation available<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/eb5f367a-15b3-4450-9410-9491946290cb?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">here</A>.</LI> </UL> <FIGURE class="nc nd ne nf ng nh nu nv paragraph-image"> <DIV class="nx ny ec nz bg oa" tabindex="0" role="button"> <DIV class="nu nv od"><PICTURE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/0*exjsRPykfNmGr9uQ.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/0*exjsRPykfNmGr9uQ.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/0*exjsRPykfNmGr9uQ.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/0*exjsRPykfNmGr9uQ.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/0*exjsRPykfNmGr9uQ.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/0*exjsRPykfNmGr9uQ.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/0*exjsRPykfNmGr9uQ.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"></SOURCE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/0*exjsRPykfNmGr9uQ.png 640w, https://miro.medium.com/v2/resize:fit:720/0*exjsRPykfNmGr9uQ.png 720w, https://miro.medium.com/v2/resize:fit:750/0*exjsRPykfNmGr9uQ.png 750w, https://miro.medium.com/v2/resize:fit:786/0*exjsRPykfNmGr9uQ.png 786w, https://miro.medium.com/v2/resize:fit:828/0*exjsRPykfNmGr9uQ.png 828w, https://miro.medium.com/v2/resize:fit:1100/0*exjsRPykfNmGr9uQ.png 1100w, https://miro.medium.com/v2/resize:fit:1400/0*exjsRPykfNmGr9uQ.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px" data-testid="og"></SOURCE></PICTURE><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="lara_rachidi_13-1720711047806.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9492i3922F469BF09EF15/image-size/medium?v=v2&px=400" role="button" title="lara_rachidi_13-1720711047806.png" alt="lara_rachidi_13-1720711047806.png" /></span> <P> </P> </DIV> </DIV> </FIGURE> <H1 id="e40b" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">MLflow 2.14</H1> <UL class=""> <LI id="2a91" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">MLflow 2.14 is GA:<SPAN> </SPAN></STRONG>MLflow is a model-agnostic framework for evaluating LLMs and AI systems, allowing you to measure and track parameters at each step. With MLflow 2.14, we released MLflow Tracing. This new feature allows developers to record each step of model and agent inference in order to debug performance issues and build evaluation datasets to test future improvements. Tracing is tightly integrated with Databricks MLflow Experiments, Databricks Notebooks, and Databricks Inference Tables, providing performance insights from development through production.</LI> <LI id="0aa1" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Watch the<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/e3865858-be62-478b-a846-e6200041ead8?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo</A><SPAN> </SPAN>from the Data+AI summit showcasing this capability.</LI> <LI id="93b6" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Documentation available<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/75262d5f-d1dd-46ba-b698-cd2efd489691?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">here</A>.</LI> <LI id="5066" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Want to know more about Deep Learning with MLflow? Watch this<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/bf138e2e-afa6-4fe8-baf4-b72ef4caf8ce?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">video</A>.</LI> <LI id="e6bd" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">This feature is also explained in the end-to-end<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/bcefeb27-b74b-48e2-94ee-e16c4b9fe209?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">demo video</A><SPAN> </SPAN>mentioned above on how to log, deploy, and debug agents.</LI> </UL> <H1 id="5ffd" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">Mosaic AI Gateway</H1> <UL class=""> <LI id="09d3" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Gateway<SPAN> </SPAN></STRONG>(fka. “External Models”) provides a unified interface to query, manage, and deploy any open source or proprietary model, enabling customers to easily switch the large language models (LLMs) that power their applications without needing to make complicated changes to the application code. It sits on Model Serving to enable rate limiting, permissions, and credential management for model APIs (external or internal). It also provides a single interface for querying foundation model APIs so that you can easily swap out models in their systems and do rapid experimentation to find the best model for a use case. Gateway Usage Tracking tracks who calls each model API and Inference Tables capture what data was sent in and out. This allows platform teams to understand how to change rate limits, implement chargebacks, and audit for data leakage.</LI> <LI id="b814" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">Documentation on how to get started<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/4907dce5-ab91-4b7c-9370-eb1cd4576fe8?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">here</A>.</LI> <LI id="7079" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph="">More features on the roadmap… Stay tuned!</LI> <LI id="cabe" class="la lb fp lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bj" data-selectable-paragraph=""><STRONG class="lc fq">Mosaic AI Guardrails</STRONG><SPAN> </SPAN>is in<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/259a54c6-f202-4430-8cb2-ee4aec7dfac5?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">private preview</A>: It allows you to add endpoint-level or request-level safety filtering to prevent unsafe responses, or even add PII detection filters to prevent sensitive data leakage. AI Guardrails is expected to be available in public preview in the coming months. In the meantime, it’s possible to enable safety filters in the Playground settings, as shown below.</LI> </UL> <FIGURE class="nc nd ne nf ng nh nu nv paragraph-image"> <DIV class="nx ny ec nz bg oa" tabindex="0" role="button"> <DIV class="nu nv oe"><PICTURE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/0*WeXxB_i82TShslT3.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/0*WeXxB_i82TShslT3.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/0*WeXxB_i82TShslT3.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/0*WeXxB_i82TShslT3.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/0*WeXxB_i82TShslT3.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/0*WeXxB_i82TShslT3.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/0*WeXxB_i82TShslT3.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"></SOURCE><SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/0*WeXxB_i82TShslT3.png 640w, https://miro.medium.com/v2/resize:fit:720/0*WeXxB_i82TShslT3.png 720w, https://miro.medium.com/v2/resize:fit:750/0*WeXxB_i82TShslT3.png 750w, https://miro.medium.com/v2/resize:fit:786/0*WeXxB_i82TShslT3.png 786w, https://miro.medium.com/v2/resize:fit:828/0*WeXxB_i82TShslT3.png 828w, https://miro.medium.com/v2/resize:fit:1100/0*WeXxB_i82TShslT3.png 1100w, https://miro.medium.com/v2/resize:fit:1400/0*WeXxB_i82TShslT3.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px" data-testid="og"></SOURCE></PICTURE><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="lara_rachidi_14-1720711047805.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9493iE4F3DB376E6F4CD4/image-size/medium?v=v2&px=400" role="button" title="lara_rachidi_14-1720711047805.png" alt="lara_rachidi_14-1720711047805.png" /></span> <P> </P> </DIV> </DIV> </FIGURE> <H1 id="d1e9" class="lz ma fp be mb mc md me mf mg mh mi mj mk ml mm mn mo mp mq mr ms mt mu mv mw bj" data-selectable-paragraph="">system.ai Catalog</H1> <UL class=""> <LI id="cc2e" class="la lb fp lc b ld mx lf lg lh my lj lk ll mz ln lo lp na lr ls lt nb lv lw lx nm nn no bj" data-selectable-paragraph=""><A class="af ly" href="https://substack.com/redirect/940787d9-eeb4-4047-a305-4d718f2c5c6c?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow"><STRONG class="lc fq">system.ai Catalog</STRONG></A><SPAN> </SPAN>is a curated list of state-of-the-art open source models that is managed by Databricks in<SPAN> </SPAN><A class="af ly" href="http://system.ai/" target="_blank" rel="noopener ugc nofollow">system.ai</A><SPAN> </SPAN>in Unity Catalog. You can easily deploy these models using Model Serving Foundation Model APIs or fine-tune them with Model Training. You can also find all supported models on the Mosaic AI Homepage by going to Settings > Developer > Personalized Homepage.</LI> </UL> <P class="pw-post-body-paragraph la lb fp lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fi bj" data-selectable-paragraph="">Follow us on Linkedin:<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/8ccafbef-0c7a-4f92-8f4a-e681ef61e8cd?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Quentin</A><SPAN> </SPAN>&<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/ea0dac90-ae15-4c79-a46d-9fb4e4238148?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Youssef</A><SPAN> </SPAN>&<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/cbe1b0dd-a43e-4e46-bf59-e0366e328c6d?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Lara</A><SPAN> </SPAN>&<SPAN> </SPAN><A class="af ly" href="https://substack.com/redirect/5d853b27-3469-4b07-9c67-479ac62f662a?j=eyJ1IjoiMnoxdnlyIn0.fANyF2qulAoFrX8WJv7agMnp8-HXi1G4liF0rdRWYRE" target="_blank" rel="noopener ugc nofollow">Maria</A><SPAN> </SPAN>&<SPAN> </SPAN><A class="af ly" href="https://www.linkedin.com/in/beatrice-liew/" target="_blank" rel="noopener ugc nofollow">Beatrice</A></P> Tue, 23 Jul 2024 09:48:03 GMT lara_rachidi 2024-07-23T09:48:03Z Data+AI Summit 2024 GenAI & ML Announcements https://community.databricks.com/t5/announcements/data-ai-summit-2024-genai-amp-ml-announcements/m-p/78367#M218 <P><A class="af mh" href="https://nextgenlakehouse.substack.com/subscribe" target="_blank" rel="noopener ugc nofollow"><STRONG class="ll fu">Subscribe</STRONG></A><STRONG class="ll fu"><SPAN> </SPAN>to the NextGenLakehouse to receive monthly updates!</STRONG></P> Tue, 23 Jul 2024 09:48:03 GMT https://community.databricks.com/t5/announcements/data-ai-summit-2024-genai-amp-ml-announcements/m-p/78367#M218 lara_rachidi 2024-07-23T09:48:03Z