- 40050 Views
- 23 replies
- 50 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 40050 Views
- 23 replies
- 50 kudos
- 1149 Views
- 1 replies
- 0 kudos
Unable to query foundation model
I was trying to run a query on the foundational model using the example given in the document. - https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html But I am getting errors. Is it the issue with the version or t...
- 1149 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you share the error message that you are receiving?
- 0 kudos
- 2727 Views
- 2 replies
- 0 kudos
Assistance with Combined Filters in Databricks Vector Store Index
Hi,I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.My index contains the following columns: product_category, product_date, and description.Question 1: How can I re...
- 2727 Views
- 2 replies
- 0 kudos
- 0 kudos
How do we do multiple filters? for example I want to filter a vector store by two columns with an AND logic.
- 0 kudos
- 7964 Views
- 5 replies
- 4 kudos
Accessing Databricks Lab Materials
Hello Databrick Support,Why is it so complex to get access to the Lab Materials after subscription. Each time I tried accessing this materials, it show a message stating "The Course has ended and no longer accessible". If this message is accurate, wh...
- 7964 Views
- 5 replies
- 4 kudos
- 4 kudos
Did this ever get resolved? I was taking the course and then stopped for a month or so to focus on other things. Now that I'm back, I can't see the labs from within the course.
- 4 kudos
- 4741 Views
- 1 replies
- 0 kudos
Preventing Genie from Returning Empty Tables as Responses
Hello! I am implementing the use of a Genie Room in my company. During development, we are encountering several situations where Genie returns an empty table.I understand that an empty table is always an error—either due to a mistake in the user's qu...
- 4741 Views
- 1 replies
- 0 kudos
- 0 kudos
I found this to be a very interesting approach.One important point to consider is that an empty result can also carry meaning. With this in mind, I provided the following instructions to Genie:When a user's query results in an empty table, first dete...
- 0 kudos
- 1853 Views
- 1 replies
- 0 kudos
Large datasets in Databricks
How can I efficiently handle large datasets in Databricks when performing group-by operations to avoid out-of-memory errors? Are there any best practices or optimizations for improving performance, such as partitioning or caching, especially when wor...
- 1853 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, @maltasa I believe this article might help answer your question.Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads
- 0 kudos
- 2391 Views
- 1 replies
- 2 kudos
Insights from a global survey of 1,100 technologists and interviews with 28 CIOs
How to unlock enterprise AI: “You can have all the AI in the world, but if it’s on a shaky data foundation, then it’s not going to bring you any value.” — Carol Clements, Chief Digital and Technology Officer, JetBlue Companies everywhere have been qu...
- 2391 Views
- 1 replies
- 2 kudos
- 2 kudos
Must read
- 2 kudos
- 2227 Views
- 1 replies
- 1 kudos
DataBricks Foundational model rate limiting approach
Hi there,is this the correct approach to fulfil the rate limit restrictions in the foundational model API?from langchain_core.rate_limiters import InMemoryRateLimiter rate_limiter = InMemoryRateLimiter( requests_per_second=2.0, check_every_...
- 2227 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @llmnerd, Yes, the approach you have outlined to fulfill the rate limit restrictions in the foundational model API using InMemoryRateLimiter from langchain_core appears to be correct. This setup should help you manage the rate limits effectivel...
- 1 kudos
- 4222 Views
- 2 replies
- 0 kudos
Retrieved Docs in Message History
Hi,I've deployed a Langchain model via MLFlow log model and a deployment agent (following this https://notebooks.databricks.com/demos/llm-rag-chatbot/index.html#)How do I add additional content to the message history for example, I'd like to add retr...
- 4222 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @davidhuang thanks for pointing to that demo! That implementation of chat history did work in my experience, but it's a little simplistic and could be token-intensive if the history needs to be maintained as a list like that. Has Databricks done a...
- 0 kudos
- 32126 Views
- 5 replies
- 7 kudos
Unity Catalog
I am new to the Databricks platform, and I am following the LLM course on youtube after being captivated by the excellent conceptual explanations and a longstanding desire to use this platform.Running the first cell in the module -%run ../Includes/Cl...
- 32126 Views
- 5 replies
- 7 kudos
- 7 kudos
I was able to address this issue by upgrading the pip library, next I modified subsequent code that attempted to update specific versions of libraries needed by the code by simply importing the specific versions.
- 7 kudos
- 4921 Views
- 3 replies
- 5 kudos
Generative Certification notebook error
I am preparing for Generative Certification and facing the below error (LookupError:) when running the notebook in the first module. These were running without any errors in the past.Complete error stack trace:****************************************...
- 4921 Views
- 3 replies
- 5 kudos
- 5 kudos
Define all the helper functions from include folder (_helper_functions.py) in your main notebook itself and run these:import nltknltk.download('punkt')nltk.download('wordnet')nltk.download('omw-1.4')nltk.download('punkt_tab')nltk.download('averaged_p...
- 5 kudos
- 3920 Views
- 1 replies
- 0 kudos
Generative Certification notebook error
Hello,I have been trying to run the GenAI course notebook and this error below. I've already tried to download the averaged_perceptron_tagger_eng as it suggests, but the error keeps coming and I am running out of ideas, does anyone can help please?Re...
- 3920 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,I too was getting same error while running the notebook on my cluster. Got fixed after running these. import nltknltk.download('punkt')nltk.download('wordnet')nltk.download('omw-1.4')nltk.download('punkt_tab')nltk.download('averaged_perceptron_tag...
- 0 kudos
- 9361 Views
- 1 replies
- 1 kudos
What model is powering the AI/BI Genie in Databricks
Hello,We are conducting feasibility study of securely opening up the new features to our team members and want to use AI/BI Genie - Genie Spaces1. How does it leverage the AI underneath .. what AI service is used , is the data shared with AI service...
- 9361 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @koantek_user, In case you haven't already found answers in documentation, AI/BI Genie uses Azure OpenAI -- your data is not used for training and model partners do not retain your data. (see trust and safety) Your data is governed and secured by ...
- 1 kudos
- 11161 Views
- 2 replies
- 0 kudos
I have not received the badge for Generative AI Fundamentals Accreditation
Hi Team,I have completed the course and cleared the exam of Generative AI Fundamentals Accreditation, but I did not receive the related badges yet. It's been 3 days.Could you please look into this matter?I appreciate if you can help.Thanks,Sravanthi
- 11161 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi srav, I have been on the same position, the badges usually arrives on 1 or 3 days, but there are some cases that they take a little more time to arrive, maybe 1 or 2 weeks.
- 0 kudos
- 8735 Views
- 1 replies
- 2 kudos
Resolved! Mosaic Vector Search
I created a RAG using a corpus of pdf which I have on ADLS. Now where will the chunked text and vector embedding be stored once I parse all the PDFs and I want to start retrieval?
- 8735 Views
- 1 replies
- 2 kudos
- 2 kudos
Option 1: Delta Sync Index with embeddings computed by Databricks You provide a source Delta table that contains data in text format. Databricks calculates the embeddings, using a model that you specify, and optionally saves the embeddings to a table...
- 2 kudos
- 2066 Views
- 1 replies
- 1 kudos
Is there a batch query option for similar vectors available in Mosaic AI Vector Search?
Hi all,I have been exploring databrick's vector search offering, and was wondering if it had the ability to run a batch query?I would like to be able to do something like the following where both embedding_1 and embedding_2 are separate vectors that ...
- 2066 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Cummings012 ,As per documentation it is not possible, as the API supports single queries.The workaround is to process these queries in parallel to improve throughput.
- 1 kudos
