- 18762 Views
- 13 replies
- 20 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 18762 Views
- 13 replies
- 20 kudos
- 356 Views
- 1 replies
- 0 kudos
Unable to query foundation model
I was trying to run a query on the foundational model using the example given in the document. - https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html But I am getting errors. Is it the issue with the version or t...
- 356 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you share the error message that you are receiving?
- 0 kudos
- 841 Views
- 2 replies
- 0 kudos
Assistance with Combined Filters in Databricks Vector Store Index
Hi,I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.My index contains the following columns: product_category, product_date, and description.Question 1: How can I re...
- 841 Views
- 2 replies
- 0 kudos
- 0 kudos
How do we do multiple filters? for example I want to filter a vector store by two columns with an AND logic.
- 0 kudos
- 2780 Views
- 5 replies
- 4 kudos
Accessing Databricks Lab Materials
Hello Databrick Support,Why is it so complex to get access to the Lab Materials after subscription. Each time I tried accessing this materials, it show a message stating "The Course has ended and no longer accessible". If this message is accurate, wh...
- 2780 Views
- 5 replies
- 4 kudos
- 4 kudos
Did this ever get resolved? I was taking the course and then stopped for a month or so to focus on other things. Now that I'm back, I can't see the labs from within the course.
- 4 kudos
- 610 Views
- 2 replies
- 0 kudos
Vector Index format.
On of the key benefits of a delta table format is that it's open. Is this also the case for vector indexes as well? If so where could I find it's specification?In Databricks today, we see that we can create and manage a vector index using API's. (ht...
- 610 Views
- 2 replies
- 0 kudos
- 0 kudos
The Delta table format is indeed open, which is one of its key benefits. However, the same cannot be said for vector indexes. The specifications for vector indexes are not openly available in the same way as Delta tables. Regarding the creation and...
- 0 kudos
- 1146 Views
- 5 replies
- 5 kudos
Resolved! Databricks AI Genie - Data Security and Thrid Party Platform
I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...
- 1146 Views
- 5 replies
- 5 kudos
- 5 kudos
I'll take a stab at "Also, how secure is Genie AI?" since I've dug into this for our own uses. There aren't many moving parts to Genie, it's really just a fine-tuned LLM and the rest is the same stuff you use in your notebooks.The most insecure part ...
- 5 kudos
- 579 Views
- 1 replies
- 0 kudos
Preventing Genie from Returning Empty Tables as Responses
Hello! I am implementing the use of a Genie Room in my company. During development, we are encountering several situations where Genie returns an empty table.I understand that an empty table is always an error—either due to a mistake in the user's qu...
- 579 Views
- 1 replies
- 0 kudos
- 0 kudos
I found this to be a very interesting approach.One important point to consider is that an empty result can also carry meaning. With this in mind, I provided the following instructions to Genie:When a user's query results in an empty table, first dete...
- 0 kudos
- 599 Views
- 1 replies
- 0 kudos
Large datasets in Databricks
How can I efficiently handle large datasets in Databricks when performing group-by operations to avoid out-of-memory errors? Are there any best practices or optimizations for improving performance, such as partitioning or caching, especially when wor...
- 599 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, @maltasa I believe this article might help answer your question.Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads
- 0 kudos
- 9037 Views
- 4 replies
- 2 kudos
Genie Space Embedded or access using a REST API
Hi all.I would like to embed Genie Space in my company's data intranet to be used like a "ChatGPT", would it be possible?Or use an API to make a call from Genie Space (in this case we would develop an interface on the intranet and send the questions ...
- 9037 Views
- 4 replies
- 2 kudos
- 406 Views
- 0 replies
- 0 kudos
How to perform combined search on structured and unstructured data in databrick using RAG or other
I created a RAG application in databricks which performs the following steps:1. Extract text from PDF files2. Prepare embeddings on extracted text and create vector search index3. Create a LLM model and served the model which can answer question base...
- 406 Views
- 0 replies
- 0 kudos
- 1144 Views
- 1 replies
- 2 kudos
Insights from a global survey of 1,100 technologists and interviews with 28 CIOs
How to unlock enterprise AI: “You can have all the AI in the world, but if it’s on a shaky data foundation, then it’s not going to bring you any value.” — Carol Clements, Chief Digital and Technology Officer, JetBlue Companies everywhere have been qu...
- 1144 Views
- 1 replies
- 2 kudos
- 2 kudos
Must read
- 2 kudos
- 628 Views
- 0 replies
- 0 kudos
AI/BI Genie - Components
I am almost certain that AI/BI Genie is using Azure OpenAi under the hood. Does anyone knows if Langchain has been used too ?
- 628 Views
- 0 replies
- 0 kudos
- 18762 Views
- 13 replies
- 20 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 18762 Views
- 13 replies
- 20 kudos
- 648 Views
- 1 replies
- 1 kudos
DataBricks Foundational model rate limiting approach
Hi there,is this the correct approach to fulfil the rate limit restrictions in the foundational model API?from langchain_core.rate_limiters import InMemoryRateLimiter rate_limiter = InMemoryRateLimiter( requests_per_second=2.0, check_every_...
- 648 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @llmnerd, Yes, the approach you have outlined to fulfill the rate limit restrictions in the foundational model API using InMemoryRateLimiter from langchain_core appears to be correct. This setup should help you manage the rate limits effectivel...
- 1 kudos
- 1137 Views
- 2 replies
- 0 kudos
Retrieved Docs in Message History
Hi,I've deployed a Langchain model via MLFlow log model and a deployment agent (following this https://notebooks.databricks.com/demos/llm-rag-chatbot/index.html#)How do I add additional content to the message history for example, I'd like to add retr...
- 1137 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @davidhuang thanks for pointing to that demo! That implementation of chat history did work in my experience, but it's a little simplistic and could be token-intensive if the history needs to be maintained as a list like that. Has Databricks done a...
- 0 kudos
- 29168 Views
- 5 replies
- 7 kudos
Unity Catalog
I am new to the Databricks platform, and I am following the LLM course on youtube after being captivated by the excellent conceptual explanations and a longstanding desire to use this platform.Running the first cell in the module -%run ../Includes/Cl...
- 29168 Views
- 5 replies
- 7 kudos
- 7 kudos
I was able to address this issue by upgrading the pip library, next I modified subsequent code that attempted to update specific versions of libraries needed by the code by simply importing the specific versions.
- 7 kudos
