- 41012 Views
- 23 replies
- 51 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 41012 Views
- 23 replies
- 51 kudos
- 2290 Views
- 1 replies
- 1 kudos
DataBricks Foundational model rate limiting approach
Hi there,is this the correct approach to fulfil the rate limit restrictions in the foundational model API?from langchain_core.rate_limiters import InMemoryRateLimiter rate_limiter = InMemoryRateLimiter( requests_per_second=2.0, check_every_...
- 2290 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @llmnerd, Yes, the approach you have outlined to fulfill the rate limit restrictions in the foundational model API using InMemoryRateLimiter from langchain_core appears to be correct. This setup should help you manage the rate limits effectivel...
- 1 kudos
- 4336 Views
- 2 replies
- 0 kudos
Retrieved Docs in Message History
Hi,I've deployed a Langchain model via MLFlow log model and a deployment agent (following this https://notebooks.databricks.com/demos/llm-rag-chatbot/index.html#)How do I add additional content to the message history for example, I'd like to add retr...
- 4336 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @davidhuang thanks for pointing to that demo! That implementation of chat history did work in my experience, but it's a little simplistic and could be token-intensive if the history needs to be maintained as a list like that. Has Databricks done a...
- 0 kudos
- 32270 Views
- 5 replies
- 7 kudos
Unity Catalog
I am new to the Databricks platform, and I am following the LLM course on youtube after being captivated by the excellent conceptual explanations and a longstanding desire to use this platform.Running the first cell in the module -%run ../Includes/Cl...
- 32270 Views
- 5 replies
- 7 kudos
- 7 kudos
I was able to address this issue by upgrading the pip library, next I modified subsequent code that attempted to update specific versions of libraries needed by the code by simply importing the specific versions.
- 7 kudos
- 5026 Views
- 3 replies
- 5 kudos
Generative Certification notebook error
I am preparing for Generative Certification and facing the below error (LookupError:) when running the notebook in the first module. These were running without any errors in the past.Complete error stack trace:****************************************...
- 5026 Views
- 3 replies
- 5 kudos
- 5 kudos
Define all the helper functions from include folder (_helper_functions.py) in your main notebook itself and run these:import nltknltk.download('punkt')nltk.download('wordnet')nltk.download('omw-1.4')nltk.download('punkt_tab')nltk.download('averaged_p...
- 5 kudos
- 4001 Views
- 1 replies
- 0 kudos
Generative Certification notebook error
Hello,I have been trying to run the GenAI course notebook and this error below. I've already tried to download the averaged_perceptron_tagger_eng as it suggests, but the error keeps coming and I am running out of ideas, does anyone can help please?Re...
- 4001 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,I too was getting same error while running the notebook on my cluster. Got fixed after running these. import nltknltk.download('punkt')nltk.download('wordnet')nltk.download('omw-1.4')nltk.download('punkt_tab')nltk.download('averaged_perceptron_tag...
- 0 kudos
- 9615 Views
- 1 replies
- 1 kudos
What model is powering the AI/BI Genie in Databricks
Hello,We are conducting feasibility study of securely opening up the new features to our team members and want to use AI/BI Genie - Genie Spaces1. How does it leverage the AI underneath .. what AI service is used , is the data shared with AI service...
- 9615 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @koantek_user, In case you haven't already found answers in documentation, AI/BI Genie uses Azure OpenAI -- your data is not used for training and model partners do not retain your data. (see trust and safety) Your data is governed and secured by ...
- 1 kudos
- 11326 Views
- 2 replies
- 0 kudos
I have not received the badge for Generative AI Fundamentals Accreditation
Hi Team,I have completed the course and cleared the exam of Generative AI Fundamentals Accreditation, but I did not receive the related badges yet. It's been 3 days.Could you please look into this matter?I appreciate if you can help.Thanks,Sravanthi
- 11326 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi srav, I have been on the same position, the badges usually arrives on 1 or 3 days, but there are some cases that they take a little more time to arrive, maybe 1 or 2 weeks.
- 0 kudos
- 8896 Views
- 1 replies
- 2 kudos
Resolved! Mosaic Vector Search
I created a RAG using a corpus of pdf which I have on ADLS. Now where will the chunked text and vector embedding be stored once I parse all the PDFs and I want to start retrieval?
- 8896 Views
- 1 replies
- 2 kudos
- 2 kudos
Option 1: Delta Sync Index with embeddings computed by Databricks You provide a source Delta table that contains data in text format. Databricks calculates the embeddings, using a model that you specify, and optionally saves the embeddings to a table...
- 2 kudos
- 2130 Views
- 1 replies
- 1 kudos
Is there a batch query option for similar vectors available in Mosaic AI Vector Search?
Hi all,I have been exploring databrick's vector search offering, and was wondering if it had the ability to run a batch query?I would like to be able to do something like the following where both embedding_1 and embedding_2 are separate vectors that ...
- 2130 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Cummings012 ,As per documentation it is not possible, as the API supports single queries.The workaround is to process these queries in parallel to improve throughput.
- 1 kudos
- 3641 Views
- 3 replies
- 0 kudos
Pyfunc mlflow loading Databricks Model failing
I am running this example notebook https://docs.databricks.com/_extras/notebooks/source/machine-learning/large-language-models/pyspark-dataframe-loader-langchain.htmlI am running most as if except switching embeddings and llm to databricks from OpenA...
- 3641 Views
- 3 replies
- 0 kudos
- 0 kudos
We abandoned this. Too many compatibility errors and we stuck with the notebook level. Good luck!
- 0 kudos
- 4254 Views
- 4 replies
- 2 kudos
Enabling vector search
I have a team member doing the GenAI certification but she gets the following errorResponse content b'{"error_code":"BAD_REQUEST","message":"This trial workspace no longer has access to Vector Search. Please upgrade the workspace to continue to use V...
- 4254 Views
- 4 replies
- 2 kudos
- 2 kudos
I am trying to enable mosiac vector search for my workspace but so far I can see the metastore in my catalog but no vector search.though I am on paid tier and have enabled unity catalog on the workspace. I am still not able to see vector search on my...
- 2 kudos
- 6654 Views
- 1 replies
- 0 kudos
from langchain.qa import RetrievalQA
Hi ,I have installed the library using "%pip install langchain", but still I couldn't import RetrievalQA. Could anyone help?
- 6654 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @dinusr ,Are you using the correct namespace langchain.chains to import?from langchain.chains import RetrievalQAIf yes, try to 1. Install the most recent version %pip install --upgrade --force-reinstall langchain2. Restart the kernel : dbutils.lib...
- 0 kudos
- 5343 Views
- 1 replies
- 0 kudos
Resolved! Vector Index Creation Initializing Phase
When using the web UI to create a vector index from an existing table with chunked data the creation fails at the "Initializing" phase after about 20 minutes. I have validated the requirements are satisfied that are detailed here.I have also seen th...
- 5343 Views
- 1 replies
- 0 kudos
- 0 kudos
I believe this "self-resolved". Even though I was technically on a premium plan the trial period had not completed. I think at this point I can say it is resolved.
- 0 kudos
- 14062 Views
- 7 replies
- 2 kudos
Resolved! Genie: Cant upvote/downvote, cant edit queries nor view other results
Hi allI have been trying to get some feedback on this before, but since this is important to if and how my organization is going to adopt this tool, I need some help on this:For me as an account admin and workspace admin, my problem is that I cant up...
- 14062 Views
- 7 replies
- 2 kudos
- 2 kudos
Amazing user story - this has been great for our internal discussions, thank you
- 2 kudos
- 5699 Views
- 2 replies
- 1 kudos
Databricks SQL Agent is failing
Goal :I want to build one Databricks SQL Agent using that any Databricks users can interact with a specified schema in Unity Catalog and generate insights on their data.Followed the url as reference :https://docs.databricks.com/en/large-language-mode...
- 5699 Views
- 2 replies
- 1 kudos
- 1 kudos
Following up on @Walter_C insights, I encountered the same issue and wanted to share the complete steps I took to fully resolve the issue:1) Upgrade SQLAlchemy: Running the following command before any other code resolved the sqlalchemy.types error: ...
- 1 kudos
