- 29010 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29010 Views
- 18 replies
- 33 kudos
- 477 Views
- 1 replies
- 0 kudos
How to utilize clustered gpu for large hf models
Hi,I am using clustered GPU(driver -1GPU and Worker-3GPU), and caching model data into unity catalog but while loading model checkpoint shards its always use driver memory and failed due insufficient memory.How to use complete cluster GPU while loadi...
- 477 Views
- 1 replies
- 0 kudos
- 0 kudos
1. Are you using any of the model parallel library, such as FSDP or DeepSpeed? Otherwise, every GPU will load the entire model weights. 2. If yes in 1, Unity Catalog Volumes are exposed on every node at /Volumes/<catalog>/<schema>/<volume>/..., so w...
- 0 kudos
- 245 Views
- 3 replies
- 0 kudos
AgentBricks Query Error
Does anyone got:[REMOTE_FUNCTION_HTTP_FAILED_ERROR]The remote HTTP request failed with code 400, and error message 'HTTP request failed with status: {"error_code": "BAD_REQUEST", "message": "Errored due to unknown error. Please contact Databricks sup...
- 245 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @gascarin Is this endpoint optimized or the base endpoint? Try optimizing the endpoint and check it again. Are you running ai_query? Can you please run it with a very simple and short prompt to see if it works?
- 0 kudos
- 367 Views
- 4 replies
- 3 kudos
Resolved! Agent Bricks not visible on free edition yet
Hi I am from Asia location and Agent bricks is not yet enabled in free version any idea till when it is expected to be released
- 367 Views
- 4 replies
- 3 kudos
- 206 Views
- 1 replies
- 1 kudos
Databricks app crash
Hello everyone,I am working on a databricks app project. IT's a chatbot on a monorepo wih a frontend built with next.js and a fastapi backend. Sometimes the app crashes unexpectedly. In the logs i see these messages : -> sending sigterms to other pro...
- 206 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey Kay0291 - Your logs suggest the app is running out of memory: exit code 137 means the OS killed your process (likely exceeding Databricks Apps’ 2 vCPU/6GB RAM limit). This often happens when both Next.js and FastAPI run together, especially under...
- 1 kudos
- 568 Views
- 2 replies
- 2 kudos
Resolved! Databricks Genie as Managed MCP server
I am trying out a Genie space to be used as a MCP server with a client. When i add the URL details and authentication PAT I get an error .. attached image file for more details. Unable to validate mcp server capabilities! Error: MCP server validation...
- 568 Views
- 2 replies
- 2 kudos
- 2 kudos
Hello @kbaig8125! Did the steps shared above help resolve your issue? If yes, please consider marking it as the accepted solution. If you found a different approach, please share it with the community so others can benefit as well.
- 2 kudos
- 750 Views
- 2 replies
- 1 kudos
LLAMA3.1 logging using mlflow
Hi team, I am facing issue after registering the meta llama 3.1 8b instruct model, while serving i get the response like{error code: BAD REQUEST, "message": "Time out while evaluating the model. Verify that the model evaluate within the timeframe."Gi...
- 750 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @HemantvIkani32! Did the above suggestion help resolve your issue? If yes, please consider marking it as the accepted solution. If you found another approach, it would be great if you could share it with the community.
- 1 kudos
- 1474 Views
- 2 replies
- 1 kudos
Preserving Intelligence and Learning during Genie Space Migration
Hi Team,How can we migrate a Genie space to a higher environment while preserving its existing intelligence and learning, along with the catalog, to avoid recreating the same knowledge.Regards,Phani
- 1474 Views
- 2 replies
- 1 kudos
- 1 kudos
Okay, maybe I’ll bring up an uncomfortable topic and ask why we should even bother trying to help you if you can’t dedicate five minutes of your time to let us know whether a suggestion or reply worked. We are spending our free time answering questio...
- 1 kudos
- 1257 Views
- 1 replies
- 0 kudos
Viewing logged User input and LLM response for a Deployed Chatbot
Hi All, I deployed a simple chatbot on Databricks Free Edition and I am trying to find the location where the user input and llm response are stored (logged) when a user asks a question (I assumed this would be in the payload table created but couldn...
- 1257 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Tee_O , are you still facing this issue?If you see (or saw) the payload table in your catalog but didn't see any rows/entries, it's probably just a time delay issue -- it can take up to 1 hr for the logs to appear. If you *don't* see the table th...
- 0 kudos
- 169 Views
- 1 replies
- 0 kudos
How to authenticate Vector Search Retriever Tool in Databricks AI Agent App?
I’m getting the following error while building a Databricks AI Agent app:databricks.vector_search.exceptions.InvalidInputException: Please specify either personal access token or service principal client ID and secret.My code looks like this: vector_...
- 169 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @atharvaghodekar ,AI agents support 3 authentication methods:- automatic authentication passthrough- on-behalf-of-use authentication (OBO)- manual authentication In case of manual authentication you need to explicitly provide credentials using en...
- 0 kudos
- 1120 Views
- 1 replies
- 1 kudos
Resolved! Databricks Managed MCP server x Claude Code
Hi everyone,I'm looking to connect the managed MCP server to Claude code on Linux and struggle to have something working. The MCP are activated on my workspace (not sure it's linked to what I want to do) and I just want to add the UC endpoint to Clau...
- 1120 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @alxsbn , did you get this resolved? Targets that are a remote HTTP endpoint need `--transport http`. For example... claude mcp add --transport http databricks-server https://xx-yyy-zzz.cloud.databricks.com/api/2.0/mcp/gold/core (see: https://docs...
- 1 kudos
- 530 Views
- 1 replies
- 1 kudos
Error while creating Agents with Agentbricks UI
While creating a Knowledge Assistant in Databricks, I encountered an issue where the endpoint update failed with the following message:"Failed to deploy: served entity creation aborted because the endpoint update timed out. Please see service logs fo...
- 530 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @sathyavikasini , Are you still facing this issue? While creating the agent, do you see that your configured knowledge sources are processing? If you haven't done so already, you might check permissions on the catalog/schema/volume(s) that are ...
- 1 kudos
- 303 Views
- 1 replies
- 0 kudos
Problem selecting data in Agents: Knowledge assistant
Hi Community, I am trying to add my unlabeled data such as txt, ppt, and pdf but none of them can be selected to usage. Please see a screenshot as I am trying to create a knowledge assistant agent, so I can feed it files and it can answer questions f...
- 303 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @magicianmanan ,In source parameter you need to provide path to the folder, not to specific file.So, for instance in my volume I have one single pdf:And in source parameter I'm providing path to directory that contains that PDF file (but not the p...
- 0 kudos
- 6843 Views
- 2 replies
- 8 kudos
How to successfully build GenAI applications
The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...
- 6843 Views
- 2 replies
- 8 kudos
- 8 kudos
To successfully Build AI Software with GenAI, focus on RAG pipelines for context-rich apps, fine-tuning or training models for domain needs, and robust evaluation for reliability. Using architectural patterns like modular microservices ensures scala...
- 8 kudos
- 466 Views
- 1 replies
- 2 kudos
Resolved! Authentication error when calling Databricks foundational model endpoint from pandas udf
Hi everyone! I’m running into an authentication error when trying to call a Databricks foundational model endpoint inside a pandas UDF. I’m using the ChatDatabricks wrapper to make completions, and this setup was working properly until last week (ima...
- 466 Views
- 1 replies
- 2 kudos
- 2 kudos
Hey DinoSaluzzi - Thanks for reaching out! The error message you're seeing—ValueError: default auth: runtime: default auth: cannot configure default credentials—reflects a stricter enforcement in how authentication happens within Spark worker nodes r...
- 2 kudos
- 323 Views
- 2 replies
- 3 kudos
Resolved! Permission denied - Genie conversation feedback API
Hi all,I am trying to use the send_message_feedback Python SDK function to post a feedback for a genie message. However, getting this error:databricks.sdk.errors.platform.PermissionDenied: This API is not yet supported.Any ideas as to where the issue...
- 323 Views
- 2 replies
- 3 kudos
