<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Databricks GenAI &amp;amp; ML Announcements — December 2024 in Announcements</title>
    <link>https://community.databricks.com/t5/announcements/databricks-genai-amp-ml-announcements-december-2024/m-p/105258#M229</link>
    <description>&lt;DIV class="eq er es et eu l"&gt;
&lt;ARTICLE&gt;
&lt;DIV class="l"&gt;
&lt;DIV class="l"&gt;
&lt;SECTION&gt;
&lt;DIV&gt;
&lt;DIV class="fj fk fl fm fn"&gt;
&lt;DIV class="ab cb"&gt;
&lt;DIV class="ci bh ev ew ex ey"&gt;
&lt;H1 id="a37c" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Streamline AI Agent Evaluation using synthetic evaluation sets (Public Preview)&lt;/H1&gt;
&lt;UL class=""&gt;
&lt;LI id="3c66" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Demo:&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.youtube.com/watch?v=8Mb91QtLzJ8" target="_blank" rel="noopener ugc nofollow"&gt;https://www.youtube.com/watch?v=8Mb91QtLzJ8&lt;/A&gt;&lt;/LI&gt;
&lt;LI id="b479" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;You can evaluate your AI agent by generating a representative evaluation set from your documents. The synthetic generation API is tightly integrated with Agent Evaluation, allowing you to quickly evaluate and improve the quality of your agent’s responses without going through the costly process of human labeling. See&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/generative-ai/agent-evaluation/synthesize-evaluation-set.html" target="_blank" rel="noopener ugc nofollow"&gt;Synthesize evaluation sets&lt;/A&gt;.&lt;/LI&gt;
&lt;LI id="b204" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;One effective method for synthesizing evaluation datasets involves using the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;generate_evals_df&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;method from the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;databricks-agents&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Python package. This method requires a DataFrame with two columns:&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;content&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;(the parsed document content as a string) and&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;doc_uri&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;(the document's URI). Developers can control the generation process using key parameters:&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;num_evals&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;(the total number of evaluations to generate),&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;agent_description&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;(the task description of the agent), and&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;question_guidelines&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;(guidelines for generating synthetic questions). The&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;num_evals&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;parameter intelligently distributes evaluations across documents, balancing the number of questions per page and considering document size. The output includes detailed columns such as&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;request_id&lt;/CODE&gt;,&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;request&lt;/CODE&gt;,&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;expected_facts&lt;/CODE&gt;, and&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;expected_retrieved_context&lt;/CODE&gt;, ensuring traceability with the corresponding&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;doc_uri&lt;/CODE&gt;. For developers unsure about how many evaluations are needed, the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;estimate_synthetic_num_evals&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;method helps estimate the ideal number of evaluations for desired coverage.&lt;/LI&gt;
&lt;LI id="8a2c" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;By using synthetic evaluation datasets, AI teams can automate and optimize the testing process, saving valuable time and achieving thorough validation of their agents’ capabilities.&lt;/LI&gt;
&lt;/UL&gt;
&lt;H1 id="df6b" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Python code executor for AI agents (Public Preview)&lt;/H1&gt;
&lt;UL class=""&gt;
&lt;LI id="80ab" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;You can now quickly give your AI agents the ability to run Python code. Databricks now offers a pre-built Unity Catalog function that can be used by an AI agent as a tool to expand their capabilities beyond language generation. See&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/generative-ai/agent-framework/code-interpreter-tools.html" target="_blank" rel="noopener ugc nofollow"&gt;Code interpreter AI agent tools&lt;/A&gt;.&lt;/LI&gt;
&lt;/UL&gt;
&lt;H1 id="9861" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Add budget policies to model serving endpoints (Public Preview)&lt;/H1&gt;
&lt;UL class=""&gt;
&lt;LI id="c48c" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Demo:&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.youtube.com/watch?v=6y9rpReGquM" target="_blank" rel="noopener ugc nofollow"&gt;https://www.youtube.com/watch?v=6y9rpReGquM&lt;/A&gt;&lt;/LI&gt;
&lt;LI id="e94a" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Effectively managing cloud computing costs is essential, especially when working with serverless compute resources. Databricks addresses this need with&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/admin/usage/budget-policies.html" target="_blank" rel="noopener ugc nofollow"&gt;&lt;STRONG class="lc fr"&gt;budget policies&lt;/STRONG&gt;&lt;/A&gt;, which help organizations track and control serverless usage. These policies work by applying tags to any serverless compute activity associated with the policy. These tags are logged in billing records, making it easier to attribute serverless spending to specific budgets and perform granular billing analysis. A notable update is that budget policies are now supported on&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;model serving endpoints&lt;/STRONG&gt;, enabling organizations to monitor and control serverless costs tied to machine learning models. See&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/machine-learning/model-serving/manage-serving-endpoints.html" target="_blank" rel="noopener ugc nofollow"&gt;Manage model serving endpoints&lt;/A&gt;.&lt;/LI&gt;
&lt;LI id="22be" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;To get started, workspace admins can create budgets in the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Account Console&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;and apply budget policies directly through the Databricks UI. Admins can also manage and view policies they have created or have permissions for. However, to manage all policies across an account, admins must also have the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Billing admin&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;role at the account level. Non-admin users can manage budget policies if they are assigned the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Budget Policy Manager&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;permissions.&lt;/LI&gt;
&lt;LI id="ac35" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Applying a budget policy is straightforward. When creating a model serving endpoint, users can select a budget policy from the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Budget Policy&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;menu in the Serving UI. If a budget policy is already assigned to a user, it will automatically apply to any new endpoints they create. Existing endpoints, however, need to be manually updated to include a budget policy. Additionally, users with&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;MANAGE&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;permissions can modify budget policies for existing endpoints via the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Endpoint Details&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;page.&lt;/LI&gt;
&lt;LI id="e127" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;It’s important to note that this feature is currently in&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Public Preview&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;and does not support endpoints serving&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;External Models&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;or&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Foundation Model APIs&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;with pay-per-token workloads. Moreover, existing endpoints won’t automatically inherit newly assigned budget policies — they must be manually updated.&lt;/LI&gt;
&lt;LI id="0836" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;By implementing budget policies, organizations can achieve greater visibility and control over their serverless spending, ensuring more effective resource management and cost optimization.&lt;/LI&gt;
&lt;/UL&gt;
&lt;FIGURE class="ly lz ma mb mc md ny nz paragraph-image"&gt;
&lt;DIV class="ob oc ed od bh oe" tabindex="0" role="button"&gt;
&lt;DIV class="ny nz oa"&gt;&lt;PICTURE&gt;&lt;SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/0*KNBOSyeOremrD2bi 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/0*KNBOSyeOremrD2bi 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/0*KNBOSyeOremrD2bi 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/0*KNBOSyeOremrD2bi 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/0*KNBOSyeOremrD2bi 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/0*KNBOSyeOremrD2bi 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/0*KNBOSyeOremrD2bi 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"&gt;&lt;/SOURCE&gt;&lt;SOURCE srcset="https://miro.medium.com/v2/resize:fit:640/0*KNBOSyeOremrD2bi 640w, https://miro.medium.com/v2/resize:fit:720/0*KNBOSyeOremrD2bi 720w, https://miro.medium.com/v2/resize:fit:750/0*KNBOSyeOremrD2bi 750w, https://miro.medium.com/v2/resize:fit:786/0*KNBOSyeOremrD2bi 786w, https://miro.medium.com/v2/resize:fit:828/0*KNBOSyeOremrD2bi 828w, https://miro.medium.com/v2/resize:fit:1100/0*KNBOSyeOremrD2bi 1100w, https://miro.medium.com/v2/resize:fit:1400/0*KNBOSyeOremrD2bi 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px" data-testid="og"&gt;&lt;/SOURCE&gt;&lt;/PICTURE&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="lara_rachidi_0-1736538849055.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/14052iA36BB40504172C86/image-size/medium?v=v2&amp;amp;px=400" role="button" title="lara_rachidi_0-1736538849055.png" alt="lara_rachidi_0-1736538849055.png" /&gt;&lt;/span&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/FIGURE&gt;
&lt;H1 id="aa4f" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Mosaic AI Model Training serverless forecasting (Public Preview)&lt;/H1&gt;
&lt;UL class=""&gt;
&lt;LI id="8d59" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Demo:&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.youtube.com/watch?v=WXF88P7tHCA" target="_blank" rel="noopener ugc nofollow"&gt;https://www.youtube.com/watch?v=WXF88P7tHCA&lt;/A&gt;&lt;/LI&gt;
&lt;LI id="5ad9" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/machine-learning/train-model/serverless-forecasting.html" target="_blank" rel="noopener ugc nofollow"&gt;Mosaic AI Model Training — forecasting&lt;/A&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;improves upon the existing AutoML forecasting experience with serverless compute, Unity Catalog support, access to deep learning algorithms, and an upgraded interface.&lt;/LI&gt;
&lt;LI id="b24c" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;The goal is to simplify time-series forecasting by automatically selecting the optimal algorithms and hyperparameters while running on fully managed, scalable compute resources.&lt;/LI&gt;
&lt;LI id="9392" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Getting Started with Serverless Forecasting&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;is straightforward. All you need is a training dataset with a time-series column stored as a&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Unity Catalog table&lt;/STRONG&gt;. If your workspace uses a&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Secure Egress Gateway (SEG)&lt;/STRONG&gt;, make sure to add&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;pypi.org&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;to the allowed domains list to avoid connectivity issues. This setup allows seamless forecasting without worrying about infrastructure management.&lt;/LI&gt;
&lt;LI id="5346" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;To begin, navigate to the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Experiments&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;tab in Databricks and use the sample dataset&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;dbdemos.dbdemos_iot_turbine.turbine_training_dataset_ml&lt;/CODE&gt;. Set the forecast frequency (e.g., hourly) and follow these steps:&lt;/LI&gt;
&lt;LI id="bb3d" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Select Training Data:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Choose your dataset from accessible Unity Catalog tables.&lt;/LI&gt;
&lt;LI id="835e" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Configure Columns:&lt;/STRONG&gt;&lt;/LI&gt;
&lt;LI id="c972" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Time Column:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Identify the column with timestamps or dates.&lt;/LI&gt;
&lt;LI id="e6d5" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Forecast Frequency:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Define the data’s time unit (minutes, hours, days, months).&lt;/LI&gt;
&lt;LI id="549e" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Forecast Horizon:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Specify how far into the future to predict.&lt;/LI&gt;
&lt;LI id="7b5d" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Prediction Target Column:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Choose the feature to forecast.&lt;/LI&gt;
&lt;LI id="b781" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Optional Settings:&lt;/STRONG&gt;&lt;/LI&gt;
&lt;LI id="f02d" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Prediction Data Path:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Store output forecasts in a Unity Catalog table.&lt;/LI&gt;
&lt;LI id="2806" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Model Registration Location:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Define where to save the trained model.&lt;/LI&gt;
&lt;LI id="4cac" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Advanced Options:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Customize experiment names, identifier columns for multi-series forecasting, evaluation metrics, training frameworks, data splits, weighting, holiday regions, and timeout settings.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P class="pw-post-body-paragraph la lb fq lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fj bk" data-selectable-paragraph=""&gt;Once configured, click&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;Start Training&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;to run the AutoML experiment. You can monitor progress, stop the experiment if needed, and explore results in real time. After training, the forecast results are saved in a Delta table, and the best-performing model is registered in the Unity Catalog.&lt;/P&gt;
&lt;P class="pw-post-body-paragraph la lb fq lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fj bk" data-selectable-paragraph=""&gt;From there, you can:&lt;/P&gt;
&lt;UL class=""&gt;
&lt;LI id="7749" class="la lb fq lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;View Predictions:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Examine the forecasting results table.&lt;/LI&gt;
&lt;LI id="17e4" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Run Batch Inference:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Use the auto-generated notebook for batch predictions.&lt;/LI&gt;
&lt;LI id="0d1c" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;STRONG class="lc fr"&gt;Deploy the Model:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Easily create a serving endpoint for real-time forecasting.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P class="pw-post-body-paragraph la lb fq lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fj bk" data-selectable-paragraph=""&gt;For a detailed comparison between&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;serverless forecasting&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;and traditional&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;STRONG class="lc fr"&gt;classic compute forecasting&lt;/STRONG&gt;, check out the official documentation&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/machine-learning/train-model/serverless-forecasting.html#serverless-forecasting-vs-classic-compute-forecasting" target="_blank" rel="noopener ugc nofollow"&gt;here&lt;/A&gt;.&lt;/P&gt;
&lt;P class="pw-post-body-paragraph la lb fq lc b ld le lf lg lh li lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx fj bk" data-selectable-paragraph=""&gt;This serverless forecasting feature empowers data teams to quickly build and deploy accurate time-series models without the burden of managing infrastructure, making forecasting more accessible and efficient than ever before.&lt;/P&gt;
&lt;H1 id="8c96" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Platform Updates&lt;/H1&gt;
&lt;UL class=""&gt;
&lt;LI id="d97b" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/release-notes/product/2024/december.html#databricks-agents-sdk-0130-release" target="_blank" rel="noopener ugc nofollow"&gt;databricks-agents SDK 0.13.0 release&lt;/A&gt;: Version 0.13.0 of the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE class="cx nu nv nw nx b"&gt;databricks-agents&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;SDK has been&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://pypi.org/project/databricks-agents/" target="_blank" rel="noopener ugc nofollow"&gt;released to PyPI&lt;/A&gt;.&lt;/LI&gt;
&lt;LI id="4a6a" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/release-notes/product/2024/december.html#meta-llama-33-is-now-available-for-provisioned-throughput-workloads" target="_blank" rel="noopener ugc nofollow"&gt;Meta Llama 3.3 is now available for provisioned throughput workloads&lt;/A&gt;&lt;/LI&gt;
&lt;LI id="39df" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/release-notes/product/2024/december.html#meta-llama-33-70b-instruct-is-now-available-on-model-serving" target="_blank" rel="noopener ugc nofollow"&gt;Meta Llama 3.3 70B Instruct is now available on Model Serving&lt;/A&gt;&lt;/LI&gt;
&lt;LI id="fa3a" class="la lb fq lc b ld np lf lg lh nq lj lk ll nr ln lo lp ns lr ls lt nt lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;&lt;A class="af mi" href="https://docs.databricks.com/en/release-notes/product/2024/december.html#bamboolib-is-now-deprecated" target="_blank" rel="noopener ugc nofollow"&gt;bamboolib is now deprecated&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;H1 id="b384" class="mj mk fq bf ml mm mn mo mp mq mr ms mt mu mv mw mx my mz na nb nc nd ne nf ng bk" data-selectable-paragraph=""&gt;Blog Posts&lt;/H1&gt;
&lt;H2 id="3255" class="og mk fq bf ml oh oi oj mp ok ol om mt ll on oo op lp oq or os lt ot ou ov ow bk" data-selectable-paragraph=""&gt;Benchmarking Domain Intelligence&lt;/H2&gt;
&lt;UL class=""&gt;
&lt;LI id="4456" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Blog post available&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.databricks.com/blog/benchmarking-domain-intelligence" target="_blank" rel="noopener ugc nofollow"&gt;here&lt;/A&gt;.&lt;/LI&gt;
&lt;/UL&gt;
&lt;H2 id="fa2a" class="og mk fq bf ml oh oi oj mp ok ol om mt ll on oo op lp oq or os lt ot ou ov ow bk" data-selectable-paragraph=""&gt;Batch Inference on Fine Tuned Llama Models with Mosaic AI Model Serving&lt;/H2&gt;
&lt;UL class=""&gt;
&lt;LI id="c13c" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Blog post available&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.databricks.com/blog/batch-inference-fine-tuned-llama-models-mosaic-ai-model-serving" target="_blank" rel="noopener ugc nofollow"&gt;here&lt;/A&gt;.&lt;/LI&gt;
&lt;/UL&gt;
&lt;H2 id="5119" class="og mk fq bf ml oh oi oj mp ok ol om mt ll on oo op lp oq or os lt ot ou ov ow bk" data-selectable-paragraph=""&gt;Build an Autonomous AI Assistant with Mosaic AI Agent Framework&lt;/H2&gt;
&lt;UL class=""&gt;
&lt;LI id="cfd4" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Blog post available&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.databricks.com/blog/build-autonomous-ai-assistant-mosaic-ai-agent-framework" target="_blank" rel="noopener ugc nofollow"&gt;here&lt;/A&gt;.&lt;/LI&gt;
&lt;/UL&gt;
&lt;H2 id="9320" class="og mk fq bf ml oh oi oj mp ok ol om mt ll on oo op lp oq or os lt ot ou ov ow bk" data-selectable-paragraph=""&gt;Aimpoint Digital: AI Agent Systems for Building Travel Itineraries&lt;/H2&gt;
&lt;UL class=""&gt;
&lt;LI id="eb16" class="la lb fq lc b ld nh lf lg lh ni lj lk ll nj ln lo lp nk lr ls lt nl lv lw lx nm nn no bk" data-selectable-paragraph=""&gt;Blog post available&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.databricks.com/blog/aimpoint-digital-ai-agent-systems" target="_blank" rel="noopener ugc nofollow"&gt;here&lt;/A&gt;.&lt;/LI&gt;
&lt;/UL&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/SECTION&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/ARTICLE&gt;
&lt;/DIV&gt;
&lt;DIV class="l"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;FOOTER class="ox oy oz pa pb ab q pc pd c"&gt;
&lt;DIV class="l ae"&gt;
&lt;DIV class="ab cb"&gt;
&lt;DIV class="ci bh ev ew ex ey"&gt;
&lt;DIV class="ab cp pe"&gt;
&lt;DIV class="ab q iu"&gt;
&lt;DIV class="pf l"&gt;
&lt;DIV class="ab q iu iv"&gt;
&lt;DIV class="pw-multi-vote-icon ed xj ix iy iz"&gt;
&lt;DIV class=""&gt;
&lt;DIV&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="64" aria-labelledby="64"&gt;
&lt;DIV class="ja xk jc jd je jf jg am jh ji jj iz"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;DIV class="bq ab"&gt;
&lt;DIV&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="8" aria-labelledby="8"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;DIV class="ab q"&gt;
&lt;DIV class="pl l hi"&gt;
&lt;DIV&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="9" aria-labelledby="9"&gt;
&lt;DIV class="bm" aria-hidden="false"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;DIV class="pl l hi"&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="postFooterSocialMenu" aria-labelledby="postFooterSocialMenu"&gt;
&lt;DIV&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="10" aria-labelledby="10"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;DIV class="bm" aria-hidden="false"&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="creatorActionOverflowMenu" aria-labelledby="creatorActionOverflowMenu"&gt;
&lt;DIV class="sj l hi"&gt;
&lt;DIV&gt;
&lt;DIV class="bm" aria-hidden="false" aria-describedby="189" aria-labelledby="189"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/FOOTER&gt;
&lt;DIV class="pm l"&gt;
&lt;DIV class="ab cb"&gt;
&lt;DIV class="ci bh ev ew ex ey"&gt;
&lt;DIV class="ab pn po pp hk hj"&gt;
&lt;DIV class="pq pr ps pt pu pv pw px py pz ab cp"&gt;
&lt;DIV class="h k"&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;</description>
    <pubDate>Fri, 10 Jan 2025 19:54:20 GMT</pubDate>
    <dc:creator>lara_rachidi</dc:creator>
    <dc:date>2025-01-10T19:54:20Z</dc:date>
    <item>
      <title>Databricks GenAI &amp; ML Announcements — December 2024</title>
      <link>https://community.databricks.com/t5/announcements/databricks-genai-amp-ml-announcements-december-2024/m-p/105258#M229</link>
      <description>&lt;P&gt;&lt;SPAN&gt;→ Subscribe to our&amp;nbsp;&lt;/SPAN&gt;&lt;A class="af mi" href="https://www.youtube.com/channel/UCIRWm64xQdLY_0DO8omKHpw" target="_blank" rel="noopener ugc nofollow"&gt;&lt;STRONG class="lc fr"&gt;YouTube channel&lt;/STRONG&gt;&lt;/A&gt;&lt;SPAN&gt;&amp;nbsp;for regular updates&lt;/SPAN&gt;&lt;/P&gt;</description>
      <pubDate>Fri, 10 Jan 2025 19:54:20 GMT</pubDate>
      <guid>https://community.databricks.com/t5/announcements/databricks-genai-amp-ml-announcements-december-2024/m-p/105258#M229</guid>
      <dc:creator>lara_rachidi</dc:creator>
      <dc:date>2025-01-10T19:54:20Z</dc:date>
    </item>
  </channel>
</rss>

