- 24370 Views
- 16 replies
- 25 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 24370 Views
- 16 replies
- 25 kudos
- 4030 Views
- 11 replies
- 2 kudos
Help with Databricks vector search index advanced metadata filtering
I have been able to successfully implement a Databricks vector search index with metadata filtering (How to create and query a vector search index | Databricks on AWS).However, I am facing a challenge when implementing a more advanced filtering mecha...
- 4030 Views
- 11 replies
- 2 kudos
- 2 kudos
sure, happy to help, let us know in case you have additional questions
- 2 kudos
- 549 Views
- 0 replies
- 0 kudos
Role of Data practitioner in AI Era
As the AI revolution takes off in 2025, there is a renewed emphasis on adopting a Data-First approach. Organizations are increasingly recognizing the need to establish a robust data foundation while preparing a skilled fleet of Data Engineers to tack...
- 549 Views
- 0 replies
- 0 kudos
- 3048 Views
- 7 replies
- 1 kudos
Resolved! Importing LanceDB Library Crashes Python Driver
Hello, I am unable to import the LanceDB library.My environment is configured as follows:Single Node of type g4dn.xlargeDBR 16.1 ML for GPUCode to Reproduce: %pip install lancedb==0.17.0 dbutils.library.restartPython() # Crashes on import import lan...
- 3048 Views
- 7 replies
- 1 kudos
- 1 kudos
Hello @victor58 thanks for your question, on your case lets start with validations based on KB https://kb.databricks.com/en_US/clusters/python-kernel-is-unresponsive-error-message
- 1 kudos
- 1902 Views
- 0 replies
- 1 kudos
Advanced RAG Retrieval (Reranking, Hierarchical, etc) in Databricks
Issue with current documentation:I wish to perform advanced RAG using langchain, in Databricks. In the documentation, they tell how to use the vector endpoint url, and index stored in catalogs. But I could not find any advanced RAG algos that are eas...
- 1902 Views
- 0 replies
- 1 kudos
- 33093 Views
- 2 replies
- 1 kudos
Databricks Genie
Hi allWe have just started a little mini project on using Genie and up until now, our experience is very positive. Therefore, Im interested in more documentation and learning materials other than what Databricks officially has (https://docs.databrick...
- 33093 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @mortenhaga , since we are also looking for the same approach, is there a way that you found out or is there any reply which helped you to figure out the above problem?
- 1 kudos
- 836 Views
- 1 replies
- 0 kudos
Error Calling Llama Guard Model from Databricks Marketplace after deploying the model
I am facing issues calling the Llama Guard Model after deploying it to Model Serving on Databricks. I deployed the model by requesting instant access from Databricks Marketplace and deployed it to Model Serving.I am following the code examples here:...
- 836 Views
- 1 replies
- 0 kudos
- 0 kudos
@javieryw, The error you are encountering, "400 Client Error: Bad Request for url: https://westus.azuredatabricks.net/serving-endpoints/llama-guard/invocations. Response text: Bad request: json: unknown field 'dataframe_split'", indicates that the p...
- 0 kudos
- 2558 Views
- 3 replies
- 1 kudos
Gen AI Fundamentals Badge
I'm trying to take the quiz and get the badge for Gen AI Fundamentals, but unfortunately unable to do so as the login credentials aren't letting me in. Please advice where to find the link to take the quiz here.
- 2558 Views
- 3 replies
- 1 kudos
- 1 kudos
I'm trying to take the quiz and get the badge for Gen AI Fundamentals, but unfortunately unable to do so as the login credentials aren't letting me in. Please advice where to find the link to take the quiz here.
- 1 kudos
- 592 Views
- 1 replies
- 0 kudos
Unable to query foundation model
I was trying to run a query on the foundational model using the example given in the document. - https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html But I am getting errors. Is it the issue with the version or t...
- 592 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you share the error message that you are receiving?
- 0 kudos
- 1381 Views
- 2 replies
- 0 kudos
Assistance with Combined Filters in Databricks Vector Store Index
Hi,I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.My index contains the following columns: product_category, product_date, and description.Question 1: How can I re...
- 1381 Views
- 2 replies
- 0 kudos
- 0 kudos
How do we do multiple filters? for example I want to filter a vector store by two columns with an AND logic.
- 0 kudos
- 4253 Views
- 5 replies
- 4 kudos
Accessing Databricks Lab Materials
Hello Databrick Support,Why is it so complex to get access to the Lab Materials after subscription. Each time I tried accessing this materials, it show a message stating "The Course has ended and no longer accessible". If this message is accurate, wh...
- 4253 Views
- 5 replies
- 4 kudos
- 4 kudos
Did this ever get resolved? I was taking the course and then stopped for a month or so to focus on other things. Now that I'm back, I can't see the labs from within the course.
- 4 kudos
- 3523 Views
- 5 replies
- 5 kudos
Resolved! Databricks AI Genie - Data Security and Thrid Party Platform
I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...
- 3523 Views
- 5 replies
- 5 kudos
- 5 kudos
I'll take a stab at "Also, how secure is Genie AI?" since I've dug into this for our own uses. There aren't many moving parts to Genie, it's really just a fine-tuned LLM and the rest is the same stuff you use in your notebooks.The most insecure part ...
- 5 kudos
- 2193 Views
- 1 replies
- 0 kudos
Preventing Genie from Returning Empty Tables as Responses
Hello! I am implementing the use of a Genie Room in my company. During development, we are encountering several situations where Genie returns an empty table.I understand that an empty table is always an error—either due to a mistake in the user's qu...
- 2193 Views
- 1 replies
- 0 kudos
- 0 kudos
I found this to be a very interesting approach.One important point to consider is that an empty result can also carry meaning. With this in mind, I provided the following instructions to Genie:When a user's query results in an empty table, first dete...
- 0 kudos
- 957 Views
- 1 replies
- 0 kudos
Large datasets in Databricks
How can I efficiently handle large datasets in Databricks when performing group-by operations to avoid out-of-memory errors? Are there any best practices or optimizations for improving performance, such as partitioning or caching, especially when wor...
- 957 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, @maltasa I believe this article might help answer your question.Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads
- 0 kudos
- 2880 Views
- 0 replies
- 0 kudos
How to perform combined search on structured and unstructured data in databrick using RAG or other
I created a RAG application in databricks which performs the following steps:1. Extract text from PDF files2. Prepare embeddings on extracted text and create vector search index3. Create a LLM model and served the model which can answer question base...
- 2880 Views
- 0 replies
- 0 kudos
- 1693 Views
- 1 replies
- 2 kudos
Insights from a global survey of 1,100 technologists and interviews with 28 CIOs
How to unlock enterprise AI: “You can have all the AI in the world, but if it’s on a shaky data foundation, then it’s not going to bring you any value.” — Carol Clements, Chief Digital and Technology Officer, JetBlue Companies everywhere have been qu...
- 1693 Views
- 1 replies
- 2 kudos
- 2 kudos
Must read
- 2 kudos
