cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30471 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30471 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
Louis_Frolio
by Databricks Employee
  • 186 Views
  • 1 replies
  • 3 kudos

Why Agent Bricks Is a Game Changer

Check out Agent Bricks — Databricks’ new framework for building AI agents without writing a single line of code. Picture this: you describe your business challenge in plain English, point it at your data, and boom… a domain-specific agent comes to li...

  • 186 Views
  • 1 replies
  • 3 kudos
Latest Reply
Brahmareddy
Esteemed Contributor
  • 3 kudos

Absolutely love the direction Databricks is heading with Agent Bricks — this is true innovation. Taking something as complex as building AI agents and turning it into a no-code, domain-aware, business-ready framework is a huge leap forward for teams ...

  • 3 kudos
GunaR
by New Contributor III
  • 912 Views
  • 11 replies
  • 1 kudos

RLS in Genie Space

I am developing a Conversational BI Solution using Genie. There are users from different roles and we need to restrict the rows returned based on the user's role. Typically RLS. I understand from documentation Genie leverage the RLS setup on the Unit...

  • 912 Views
  • 11 replies
  • 1 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 1 kudos

You can implement RLS in Genie without adding users to Databricks by passing a user identifier with each API call and having your queries filter rows based on that ID. Typically, you’d set up parameterized queries or session variables that enforce ro...

  • 1 kudos
10 More Replies
Rjdudley
by Honored Contributor
  • 219 Views
  • 4 replies
  • 0 kudos

Add AI Guardrail results into response?

We're considering switching from Azure AI Foundry to Mosaic AI Gateway.  One nice feature AI Foundry has is it adds the content filter results to the response (and in a streaming response, each delta).  This allows us to provide some feedback to the ...

  • 219 Views
  • 4 replies
  • 0 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 0 kudos

To include AI Guardrail results in your responses, you need to enable logging or metadata propagation when the model generates output. Check if Mosaic AI Gateway supports attaching Guardrail flags or filter results as part of the response payload or ...

  • 0 kudos
3 More Replies
foubs
by New Contributor II
  • 185 Views
  • 3 replies
  • 0 kudos

Databrcks + sharepoint +Microsoft Teams Bot

I recently created a Teams Bot using Databricks Genie, and some of the data I want to retrieve from Databricks can be very large. The solution I am thinking of is for every bot request which will lead to lots of rows and columns to be retrieved, I wa...

  • 185 Views
  • 3 replies
  • 0 kudos
Latest Reply
foubs
New Contributor II
  • 0 kudos

Hello @KaushalVachhani I was trying to find out if Databricks already has a template for this part "Genie Conversation API, saves it as a CSV file, and uploads it to SharePoint" Because the data might be big, eg more than 50 rows with more than four ...

  • 0 kudos
2 More Replies
Rjdudley
by Honored Contributor
  • 151 Views
  • 2 replies
  • 1 kudos

System tables for vector search index?

Are there system tables or log files for monitoring vector search index searches?  I didn't see vector search mentioned on the system tables documentation (Monitor account activity with system tables - Azure Databricks | Microsoft Learn).

  • 151 Views
  • 2 replies
  • 1 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 1 kudos

Thanks @mark_ott are there plans to make the vector search a "proper" system table in Databricks rather than using an Azure Monitor table?

  • 1 kudos
1 More Replies
Darshan13
by New Contributor
  • 148 Views
  • 1 replies
  • 1 kudos

MLflow LangChain Model Serving Fails: _UNSUPPORTED_MODEL_ERROR_MESSAGE ImportError

I’m trying to log and serve a LangChain-based RFI chatbot model using MLflow in Databricks, but I’m encountering the following error when loading the model:ImportError: cannot import name '_UNSUPPORTED_MODEL_ERROR_MESSAGE' from 'mlflow.langchain.util...

  • 148 Views
  • 1 replies
  • 1 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 1 kudos

@Darshan13 , Based on the error, It looks like when Databricks Model Serving tries to load your model, MLflow's internal code attempts to import _UNSUPPORTED_MODEL_ERROR_MESSAGE which doesn't exist in the LangChain utils structure. Are you successful...

  • 1 kudos
mcarreira
by New Contributor
  • 3202 Views
  • 1 replies
  • 0 kudos

Add Azure Databricks tables as knowledge source into Copilot Studio Agent

Hello!I’m trying to add some tables from my Azure Databricks as a knowledge source in a Copilot Studio agent so that I can ask questions about the information stored in these tables.The connection is created successfully, and I can see a preview of m...

  • 3202 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

If your Azure Databricks tables show up as a knowledge source in Copilot Studio, but the agent cannot access data when you ask questions, the issue is often related to user or service account permissions, network rules, or the configuration of the ta...

  • 0 kudos
heramb13
by New Contributor II
  • 5695 Views
  • 4 replies
  • 0 kudos

Unable to log MLFlow run for LangChain chain while using databricks-langchain library

Whenever I try to log my run it throws me the following error: MlflowException: Failed to save runnable sequence: {'0': 'RunnableParallel<query,context> -- Failed to save runnable sequence: {\'context\': "RunnableSequence -- Failed to save runnable s...

  • 5695 Views
  • 4 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @heramb13 , Your chain is being serialized by MLflow; during that process MLflow re-imports each runnable by its module path. The error shows MLflow is trying to import ChatDatabricks from the legacy module path “langchain_databricks”, which isn’t...

  • 0 kudos
3 More Replies
yashshingvi
by New Contributor
  • 4094 Views
  • 1 replies
  • 0 kudos

Unable to add dependencies to mlflow.langchain.log_model

Hello,I'm doing this-with mlflow.start_run(run_name="run1"): logged_chain_info = mlflow.langchain.log_model( # lc_model=os.path.join(os.getcwd(), 'full_chain'), this doesnt work too lc_model='/Workspace/Users/{user_name}/exp/d...

  • 4094 Views
  • 1 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @yashshingvi , Thanks for the details—this is a common gotcha with MLflow “models from code.” Why your imports fail code_paths are only added to sys.path when the model is loaded (for inference/serving), not while the driver is executing mlflow.la...

  • 0 kudos
samueldaly
by New Contributor II
  • 4132 Views
  • 1 replies
  • 2 kudos

AI/BI Genie - Real world experience?

I have been tasked with creating a NLP interface for management to our internal datalake that has numerous joined tables around customer information. I have tried the hello-world llamaindex, langchain sql/pandas agents with limited success (too many ...

  • 4132 Views
  • 1 replies
  • 2 kudos
Latest Reply
mitchellg-db
Databricks Employee
  • 2 kudos

Hi there Sam,I work for Databricks. The pace of innovation with AI/BI is wild (fast). Databricks itself just migrated off a leading BI platform and now exclusively runs its business on AI/BI (Blog). We also have customer testimonials on our website, ...

  • 2 kudos
Rjdudley
by Honored Contributor
  • 300 Views
  • 2 replies
  • 2 kudos

Resolved! Where are GPT-5 and Gemini in Azure Databricks?

Are GPT-5 and Gemini not available in Azure Databricks?  According to Native OpenAI Models Now Generally Available on Databricks | Databricks Blog and Google’s Gemini Models on Databricks | Databricks Blog these are both GA with no mention of platfor...

  • 300 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @Rjdudley ,They're not available yet on Azure Databricks. Here's  up-to-date list of all available mode right now:Databricks-hosted foundation models available in Foundation Model APIs - Azure Databricks | Microsoft LearnSo, we need some patience ...

  • 2 kudos
1 More Replies
Karthik_Karanm
by New Contributor III
  • 2512 Views
  • 5 replies
  • 3 kudos

Using Genie in Multi-Agent Systems — SQL Query Missing from Output

Hi Community,I’ve implemented a multi-agent system using Genie in Databricks, following the guide on "Use Genie in multi-agent systems | Databricks Documentation". The system integrates well with vector indexes, and everything works fine during model...

  • 2512 Views
  • 5 replies
  • 3 kudos
Latest Reply
mark_ott
Databricks Employee
  • 3 kudos

When using a custom Genie agent with the Databricks Genie REST API (GetMessage endpoint), extracting SQL queries and results works well as a standalone agent. However, integrating this custom agent into a multi-agent framework (especially when combin...

  • 3 kudos
4 More Replies
BriceBuso
by Contributor II
  • 4457 Views
  • 2 replies
  • 0 kudos

DatabricksFunctionClient : PERMISSION_DENIED when creating the client

Hello, I'm currently working with Databricks features to create an AI agent system. In the documentation it's written that the library DatabricksFunctionClient is needed to register custom tools to UC.  I followed the different steps from the explana...

BriceBuso_1-1742486473481.png
  • 4457 Views
  • 2 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

This error is most often due to missing permissions, workspace types, or cluster configuration settings necessary for AI agents and custom tools to access Unity Catalog (UC) functions using Spark Connect in Databricks. The main causes and solutions a...

  • 0 kudos
1 More Replies
ericy
by New Contributor
  • 4370 Views
  • 3 replies
  • 2 kudos

Langchain SQLDatabase not fetching column names from table in Unity Catalog

I am building a text-to-sql agent using Langchain API.I created a SQLDatabase using: db = SQLDatabase.from_databricks(catalog="`my-catalog-name`", schema="my_schema", host="...", api_token="...", warehouse_id="12345678")When I call db.get_table_info(...

  • 4370 Views
  • 3 replies
  • 2 kudos
Latest Reply
Thompson2345
New Contributor III
  • 2 kudos

The issue happens because SQLDatabase.from_databricks doesn’t automatically fetch column metadata from Unity Catalog tables in some LangChain versions, leading to malformed SELECT statements. A workaround is to manually query the catalog like you did...

  • 2 kudos
2 More Replies
meetiasha
by New Contributor II
  • 4345 Views
  • 1 replies
  • 1 kudos

Advanced RAG Retrieval (Reranking, Hierarchical, etc) in Databricks

Issue with current documentation:I wish to perform advanced RAG using langchain, in Databricks. In the documentation, they tell how to use the vector endpoint url, and index stored in catalogs. But I could not find any advanced RAG algos that are eas...

  • 4345 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @meetiasha , yes—there’s a gap between Databricks’ basic “vector endpoint + catalog index” examples and truly advanced RAG, so below is a step‑wise, LangChain‑first playbook you can run entirely on Databricks notebooks with local vector sto...

  • 1 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now