cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 20321 Views
  • 12 replies
  • 22 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 20321 Views
  • 12 replies
  • 22 kudos
Latest Reply
santhakumar11
New Contributor II
  • 22 kudos

Thank you for sharing  

  • 22 kudos
11 More Replies
paalvibe
by New Contributor III
  • 566 Views
  • 3 replies
  • 0 kudos

Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?

In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...

  • 566 Views
  • 3 replies
  • 0 kudos
Latest Reply
paalvibe
New Contributor III
  • 0 kudos

Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...

  • 0 kudos
2 More Replies
Nawneet
by New Contributor II
  • 240 Views
  • 1 replies
  • 0 kudos

Error running mlflow.evaluate()

Hi Team,I am following below article to evaluate my model.What is Mosaic AI Agent Evaluation? | Databricks on AWSExample for my model is below:input_example = pd.DataFrame({    "text": ["What is the stoppage duration for January month 2024?"],    "pa...

  • 240 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @Nawneet, Ensure that the input format for the agent evaluation matches the expected schema. Here is an example to structure your input data correctly: import mlflow import pandas as pd examples = { "request": [ {"messages": [{"ro...

  • 0 kudos
wind2025
by New Contributor II
  • 686 Views
  • 1 replies
  • 1 kudos

I am struggling on complicated RAG code for Mosaic evaluation deployment

I want to know how I can apply some complicated RAG designs so I can directly deploy on the Mosaic AI evaluation UI. There are two cases:1. two or more index retrieval as independent tools (parallel retrievals)2.two index retrieval processes that dep...

  • 686 Views
  • 1 replies
  • 1 kudos
Latest Reply
Mantsama4
Contributor III
  • 1 kudos

Interesting use case, would love to know the answer!

  • 1 kudos
MarsWalker
by New Contributor
  • 648 Views
  • 0 replies
  • 0 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 648 Views
  • 0 replies
  • 0 kudos
heramb13
by New Contributor II
  • 877 Views
  • 3 replies
  • 0 kudos

Unable to log MLFlow run for LangChain chain while using databricks-langchain library

Whenever I try to log my run it throws me the following error: MlflowException: Failed to save runnable sequence: {'0': 'RunnableParallel<query,context> -- Failed to save runnable sequence: {\'context\': "RunnableSequence -- Failed to save runnable s...

  • 877 Views
  • 3 replies
  • 0 kudos
Latest Reply
heramb13
New Contributor II
  • 0 kudos

@Alberto_Umana or anyone? 

  • 0 kudos
2 More Replies
Kjetil
by Contributor
  • 865 Views
  • 4 replies
  • 4 kudos

Model Serving and Streaming

Hi everyone,I have a question regarding the concurrency limitations of streaming responses from an LLM chain via Databricks Model Serving.When using a streaming response, the request remains open for the duration of the generation process. For exampl...

  • 865 Views
  • 4 replies
  • 4 kudos
Latest Reply
LaurenFletcher
New Contributor II
  • 4 kudos

Wow, Thank you so much for your help.

  • 4 kudos
3 More Replies
kbmv
by Contributor
  • 1104 Views
  • 1 replies
  • 0 kudos

Resolved! Understanding compute requirements for Deploying Deepseek-R1-Distilled-Llama Models on databricks

Hi I came across the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricksI am new to using custom models that are not available as part of foundation models.According to the blog, I...

kbmv_0-1738850768911.png
  • 1104 Views
  • 1 replies
  • 0 kudos
Latest Reply
kbmv
Contributor
  • 0 kudos

Its Resolved https://community.databricks.com/t5/machine-learning/understanding-compute-requirements-for-deploying-deepseek-r1/m-p/109357#M3956

  • 0 kudos
dileepkumar_t
by New Contributor
  • 1374 Views
  • 1 replies
  • 0 kudos

Error - Interact with SQL database

 When I try to use Datbricks sql agent, I'm getting below error:DatabaseError: (databricks.sql.exc.ServerOperationError) [UNBOUND_SQL_PARAMETER] Found the unbound parameter: param_1. Please, fix `args` and provide a mapping of the parameter to a SQL ...

  • 1374 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

Hi @dileepkumar_t The UNBOUND_SQL_PARAMETER error in Databricks SQL Agent occurs when a parameter marker in a SQL query is not associated with a value. This error is raised because the SQL query is expecting a parameter to be provided, but it has not...

  • 0 kudos
Mohanrajv27
by New Contributor
  • 1130 Views
  • 1 replies
  • 0 kudos

Cost Analysis for Databricks Compute

I am currently using the Databricks Vector Search on top of my databricks workspace and running the DBRX Model for querying off and retrieve the results out of it.I have noticed something, a category of compute occurred, which I haven't seen earlier....

  • 1130 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

Hi @Mohanrajv27 The "Automated Serverless compute Pro" category in Databricks is designed to provide a serverless environment where compute resources are automatically managed and scaled by Databricks. Hope this answers your question!

  • 0 kudos
thmonte
by New Contributor II
  • 390 Views
  • 2 replies
  • 1 kudos

Tool Calls with Workspace Models

I recently followed the blog post on running deepseek llama distilled.  I then served it via Serving Endpoints with provisioned throughput.  In my use case I am using pydantic-ai to build out some simple agents for testing.  It seems with this style ...

  • 390 Views
  • 2 replies
  • 1 kudos
Latest Reply
thmonte
New Contributor II
  • 1 kudos

Thanks @Alberto_Umana which one of these controls allows the conversation to continue past the first tool call?  Is there documentation on all configurable fields?  Also does this still allow override some of these at the client level? Ex. passing in...

  • 1 kudos
1 More Replies
SristiRaj
by New Contributor
  • 452 Views
  • 1 replies
  • 0 kudos

Databricks REST api to manage and deploy Genie spaces programmatically

Hello,I am looking to find documentation for databricks REST api for creating and deploying genie spaces with necessary configuration. Could you please guide me to the documentation for the same.Regards,Sristi Raj 

  • 452 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @SristiRaj, Currently there is not API for that. I see that Databricks Genie Conversation APIs are currently in private preview. Please stay tune for news on this!

  • 0 kudos
aliciachimeno
by New Contributor II
  • 1003 Views
  • 2 replies
  • 0 kudos

Integrating LangGraph with AI Cookbook Agent Template on Databricks using MLflow

I am working on building an agent using the AI Cookbook Agent Template and would like to integrate LangGraph into the agent template. Specifically, I want to build an agent that uses an adaptive RAG  chain and an SQL agent. My goal is to implement th...

  • 1003 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @aliciachimeno, Please take a look at: https://github.com/databricks/genai-cookbook

  • 0 kudos
1 More Replies
vipintyagi
by New Contributor II
  • 1115 Views
  • 2 replies
  • 3 kudos

Resolved! Databricks Certified Generative AI Engineer Associate

Hi, I passed Databricks Certified Generative AI Engineer Associate exam yesterday and I havent received certificate. I verified my accredible account but it is not reflecting. In fact, there are several partner training I did last month and they are ...

  • 1115 Views
  • 2 replies
  • 3 kudos
Latest Reply
Advika_
Databricks Employee
  • 3 kudos

Hello @vipintyagi!Your certificate has already been sent. Please ensure you're using the same email ID for your Accredible account as the one used during exam registration.

  • 3 kudos
1 More Replies