- 16842 Views
- 13 replies
- 20 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 16842 Views
- 13 replies
- 20 kudos
- 695 Views
- 1 replies
- 0 kudos
Generative Certification notebook error
Hello,I have been trying to run the GenAI course notebook and this error below. I've already tried to download the averaged_perceptron_tagger_eng as it suggests, but the error keeps coming and I am running out of ideas, does anyone can help please?Re...
- 695 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,I too was getting same error while running the notebook on my cluster. Got fixed after running these. import nltknltk.download('punkt')nltk.download('wordnet')nltk.download('omw-1.4')nltk.download('punkt_tab')nltk.download('averaged_perceptron_tag...
- 0 kudos
- 362 Views
- 0 replies
- 0 kudos
Best Practices for Multilingual Model Training: Single vs. Multi-Model for Translation
Hello everyone,I’m working on a translation project involving documents up to 100 pages long, in 17 different languages, and I'm looking for the best approach to achieve high-quality translations in this multilingual context.Single model vs. multi-mo...
- 362 Views
- 0 replies
- 0 kudos
- 266 Views
- 1 replies
- 0 kudos
Assistance with Combined Filters in Databricks Vector Store Index
Hi,I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.My index contains the following columns: product_category, product_date, and description.Question 1: How can I re...
- 266 Views
- 1 replies
- 0 kudos
- 0 kudos
You can achieve that by using metadata filtering when querying the VS index. Check this section in our VS Index documentation: https://docs.databricks.com/en/generative-ai/create-query-vector-search.html#query-a-vector-search-endpoint
- 0 kudos
- 630 Views
- 1 replies
- 0 kudos
What model is powering the AI/BI Genie in Databricks
Hello,We are conducting feasibility study of securely opening up the new features to our team members and want to use AI/BI Genie - Genie Spaces1. How does it leverage the AI underneath .. what AI service is used , is the data shared with AI service...
- 630 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @koantek_user, In case you haven't already found answers in documentation, AI/BI Genie uses Azure OpenAI -- your data is not used for training and model partners do not retain your data. (see trust and safety) Your data is governed and secured by ...
- 0 kudos
- 281 Views
- 2 replies
- 0 kudos
I have not received the badge for Generative AI Fundamentals Accreditation
Hi Team,I have completed the course and cleared the exam of Generative AI Fundamentals Accreditation, but I did not receive the related badges yet. It's been 3 days.Could you please look into this matter?I appreciate if you can help.Thanks,Sravanthi
- 281 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi srav, I have been on the same position, the badges usually arrives on 1 or 3 days, but there are some cases that they take a little more time to arrive, maybe 1 or 2 weeks.
- 0 kudos
- 1449 Views
- 1 replies
- 2 kudos
Resolved! Mosaic Vector Search
I created a RAG using a corpus of pdf which I have on ADLS. Now where will the chunked text and vector embedding be stored once I parse all the PDFs and I want to start retrieval?
- 1449 Views
- 1 replies
- 2 kudos
- 2 kudos
Option 1: Delta Sync Index with embeddings computed by Databricks You provide a source Delta table that contains data in text format. Databricks calculates the embeddings, using a model that you specify, and optionally saves the embeddings to a table...
- 2 kudos
- 307 Views
- 1 replies
- 1 kudos
Is there a batch query option for similar vectors available in Mosaic AI Vector Search?
Hi all,I have been exploring databrick's vector search offering, and was wondering if it had the ability to run a batch query?I would like to be able to do something like the following where both embedding_1 and embedding_2 are separate vectors that ...
- 307 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Cummings012 ,As per documentation it is not possible, as the API supports single queries.The workaround is to process these queries in parallel to improve throughput.
- 1 kudos
- 1091 Views
- 3 replies
- 0 kudos
Pyfunc mlflow loading Databricks Model failing
I am running this example notebook https://docs.databricks.com/_extras/notebooks/source/machine-learning/large-language-models/pyspark-dataframe-loader-langchain.htmlI am running most as if except switching embeddings and llm to databricks from OpenA...
- 1091 Views
- 3 replies
- 0 kudos
- 0 kudos
We abandoned this. Too many compatibility errors and we stuck with the notebook level. Good luck!
- 0 kudos
- 988 Views
- 4 replies
- 2 kudos
Enabling vector search
I have a team member doing the GenAI certification but she gets the following errorResponse content b'{"error_code":"BAD_REQUEST","message":"This trial workspace no longer has access to Vector Search. Please upgrade the workspace to continue to use V...
- 988 Views
- 4 replies
- 2 kudos
- 2 kudos
I am trying to enable mosiac vector search for my workspace but so far I can see the metastore in my catalog but no vector search.though I am on paid tier and have enabled unity catalog on the workspace. I am still not able to see vector search on my...
- 2 kudos
- 319 Views
- 1 replies
- 0 kudos
from langchain.qa import RetrievalQA
Hi ,I have installed the library using "%pip install langchain", but still I couldn't import RetrievalQA. Could anyone help?
- 319 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @dinusr ,Are you using the correct namespace langchain.chains to import?from langchain.chains import RetrievalQAIf yes, try to 1. Install the most recent version %pip install --upgrade --force-reinstall langchain2. Restart the kernel : dbutils.lib...
- 0 kudos
- 516 Views
- 1 replies
- 2 kudos
Serving endpoint with external model (azure openai) is throwing "Public network access is disable "
Databricks serving endpoint is not working as expected throwing an exception as "Public network access is disable, Create private endpoints".We have create the azure openAI resource with public network access disabled, but also we have created the pr...
- 516 Views
- 1 replies
- 2 kudos
- 2 kudos
I am also encountering the exact issue.
- 2 kudos
- 2506 Views
- 1 replies
- 0 kudos
Resolved! Vector Index Creation Initializing Phase
When using the web UI to create a vector index from an existing table with chunked data the creation fails at the "Initializing" phase after about 20 minutes. I have validated the requirements are satisfied that are detailed here.I have also seen th...
- 2506 Views
- 1 replies
- 0 kudos
- 0 kudos
I believe this "self-resolved". Even though I was technically on a premium plan the trial period had not completed. I think at this point I can say it is resolved.
- 0 kudos
- 483 Views
- 0 replies
- 0 kudos
Error - Interact with SQL database
When I try to use Datbricks sql agent, I'm getting below error:DatabaseError: (databricks.sql.exc.ServerOperationError) [UNBOUND_SQL_PARAMETER] Found the unbound parameter: param_1. Please, fix `args` and provide a mapping of the parameter to a SQL ...
- 483 Views
- 0 replies
- 0 kudos
- 447 Views
- 0 replies
- 0 kudos
Data security when using Databricks Foundation Model endpoints
Hi Databricks,My client is considering using Databricks as the solution to their RAG chatbot framework. We are testing on the Databrick's demo tutorial on its own documentation data (pdf files). The tutorial is provided at: 00-RAG-chatbot-Introductio...
- 447 Views
- 0 replies
- 0 kudos
- 491 Views
- 1 replies
- 0 kudos
Using generative AI to generate descriptions
Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it ...
- 491 Views
- 1 replies
- 0 kudos
- 0 kudos
You can use ai_query function to achieve this in SQL. It takes an LLM endpoint and a prompt as input. Here's an example with DBRX and a specific Indian manufacturing industry-related prompt. create or replace function ai_create_table_metadata (table...
- 0 kudos
