Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it ...
You can use ai_query function to achieve this in SQL. It takes an LLM endpoint and a prompt as input.
Here's an example with DBRX and a specific Indian manufacturing industry-related prompt.
create
or replace function ai_create_table_metadata (table...
Hi allI have been trying to get some feedback on this before, but since this is important to if and how my organization is going to adopt this tool, I need some help on this:For me as an account admin and workspace admin, my problem is that I cant up...
Goal :I want to build one Databricks SQL Agent using that any Databricks users can interact with a specified schema in Unity Catalog and generate insights on their data.Followed the url as reference :https://docs.databricks.com/en/large-language-mode...
Following up on @Walter_C insights, I encountered the same issue and wanted to share the complete steps I took to fully resolve the issue:1) Upgrade SQLAlchemy: Running the following command before any other code resolved the sqlalchemy.types error: ...
Hi guys, I would like to add the repo linked to the "Generative AI with Databricks" course. Do you know where I could find the repo with the notebooks that get shown in the demos in that course?. Best
Goal :Here below I am attaching my code snippet where I am trying to build an agent on my custom functions .Things are working well when I am running agent.invoke(“Question”).But now I want to deploy this agent into model registry using MLFlow but I ...
We need a sample code or process which will help us to dynamically select the prompt template based on the prompt given as an input through the model legacy serving endpoint
Goal:Let's say we have a custom function with arbitrary python code . And we want to deploy that as model as we wanted to generate an API endpoint .So that that can be accessed from external applications.I am attaching the below code I have tried .If...
The execution of code stucks when evaluation of data start. eval_df = pd.DataFrame( { "inputs": [ "What is MLflow?", "What is Spark?", ], "ground_truth": [ "MLflow is an open-source platform f...
Hello all,For some reason, I can't find llama-3.0 models on either the playground or serving endpoints even though we've been using it for months.I can see both llama-3.1 models on the serving endpoints page and it also says they have been last modif...
@tefrati Thank you for your patience on this one! The pricing remains the same. Our team found version 3.1 to be better than 3 in many aspects, with the added benefit of not requiring any prompt changes. As a result, we have transitioned to 3.1. Our ...
Hello,I am trying to forecast using ai_forecast function and I get this error (https://docs.databricks.com/en/sql/language-manual/functions/ai_forecast.html)I changed my cluster to use current channel yet this is not solved.. any idea why this occurs...
Hi @sue01 ,Make sure that you run it on clusters aligned with below recommendations:"Only available on Pro SQL warehouses running Databricks SQL version 2024.35 and above"
Hi!Have anyone experienced that you cant see the result of what Genie produced as an answer in the history of a chat session? How can I enable to view and correct historical answers for any Genie chat?
I am working in the following environment:- New Databricks workspsace with UC enabled- Azure, region west-europe- Cluster: Interactive (DBR 15.4), or SQL Warehouse (Serverless)Running for example:SELECT ai_gen('Generate a concise, cheerful email titl...
Hello @Michael_Galli Sorry for the delay in my response. Unfortunately, only the two models you mentioned, Meta Llama 3.1 70B Instruct and GTE Large (En), are currently available in the EU Geo. Our team is working to make more models available soon f...
I have been tasked with creating a NLP interface for management to our internal datalake that has numerous joined tables around customer information. I have tried the hello-world llamaindex, langchain sql/pandas agents with limited success (too many ...
Dear Databricks Team,I hope this email finds you well.I would like to share a specific Genie Space URL with a user, but I want to ensure that the user only has access to view this particular Genie Space ask questions in that space and no other featur...