cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30070 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30070 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
Cummings012
by New Contributor II
  • 1304 Views
  • 1 replies
  • 1 kudos

Is there a batch query option for similar vectors available in Mosaic AI Vector Search?

Hi all,I have been exploring databrick's vector search offering, and was wondering if it had the ability to run a batch query?I would like to be able to do something like the following where both embedding_1 and embedding_2 are separate vectors that ...

Cummings012_0-1729087701912.png
  • 1304 Views
  • 1 replies
  • 1 kudos
Latest Reply
filipniziol
Esteemed Contributor
  • 1 kudos

Hi @Cummings012 ,As per documentation it is not possible, as the API supports single queries.The workaround is to process these queries in parallel to improve throughput.

  • 1 kudos
swollazn
by New Contributor II
  • 2637 Views
  • 3 replies
  • 0 kudos

Pyfunc mlflow loading Databricks Model failing

I am running this example notebook https://docs.databricks.com/_extras/notebooks/source/machine-learning/large-language-models/pyspark-dataframe-loader-langchain.htmlI am running most as if except switching embeddings and llm to databricks from OpenA...

  • 2637 Views
  • 3 replies
  • 0 kudos
Latest Reply
swollazn
New Contributor II
  • 0 kudos

We abandoned this. Too many compatibility errors and we stuck with the notebook level. Good luck!

  • 0 kudos
2 More Replies
WynanddB
by New Contributor III
  • 2676 Views
  • 4 replies
  • 2 kudos

Enabling vector search

I have a team member doing the GenAI certification but she gets the following errorResponse content b'{"error_code":"BAD_REQUEST","message":"This trial workspace no longer has access to Vector Search. Please upgrade the workspace to continue to use V...

  • 2676 Views
  • 4 replies
  • 2 kudos
Latest Reply
nagND
New Contributor II
  • 2 kudos

I am trying to enable mosiac vector search for my workspace but so far I can see the metastore in my catalog but no vector search.though I am on paid tier and have enabled unity catalog on the workspace. I am still not able to see vector search on my...

  • 2 kudos
3 More Replies
dinusr
by New Contributor
  • 1480 Views
  • 1 replies
  • 0 kudos

from langchain.qa import RetrievalQA

Hi ,I have installed the library using "%pip install langchain", but still I couldn't import RetrievalQA. Could anyone help?

  • 1480 Views
  • 1 replies
  • 0 kudos
Latest Reply
filipniziol
Esteemed Contributor
  • 0 kudos

Hi @dinusr ,Are you using the correct namespace langchain.chains to import?from langchain.chains import RetrievalQAIf yes, try to 1. Install the most recent version %pip install --upgrade --force-reinstall langchain2. Restart the kernel : dbutils.lib...

  • 0 kudos
Galactech
by New Contributor III
  • 4418 Views
  • 1 replies
  • 0 kudos

Resolved! Vector Index Creation Initializing Phase

When using the web UI to create a vector index from an existing table with chunked data the creation fails at the "Initializing" phase after about 20 minutes.  I have validated the requirements are satisfied that are detailed here.I have also seen th...

  • 4418 Views
  • 1 replies
  • 0 kudos
Latest Reply
Galactech
New Contributor III
  • 0 kudos

I believe this "self-resolved".  Even though I was technically on a premium plan the trial period had not completed.  I think at this point I can say it is resolved.

  • 0 kudos
monke64
by New Contributor
  • 1770 Views
  • 1 replies
  • 0 kudos

Using generative AI to generate descriptions

Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it ...

  • 1770 Views
  • 1 replies
  • 0 kudos
Latest Reply
vikasgautam
Databricks Employee
  • 0 kudos

You can use ai_query function to achieve this in SQL. It takes an LLM endpoint and a prompt as input. Here's an example with DBRX and a specific Indian manufacturing industry-related prompt. create or replace function ai_create_table_metadata (table...

  • 0 kudos
mortenhaga2
by New Contributor III
  • 11538 Views
  • 7 replies
  • 2 kudos

Resolved! Genie: Cant upvote/downvote, cant edit queries nor view other results

Hi allI have been trying to get some feedback on this before, but since this is important to if and how my organization is going to adopt this tool, I need some help on this:For me as an account admin and workspace admin, my problem is that I cant up...

mortenhaga2_0-1725264270178.png mortenhaga2_1-1725264435843.png mortenhaga2_3-1725264479589.png
  • 11538 Views
  • 7 replies
  • 2 kudos
Latest Reply
holly
Databricks Employee
  • 2 kudos

Amazing user story - this has been great for our internal discussions, thank you

  • 2 kudos
6 More Replies
SandipCoder
by New Contributor II
  • 2999 Views
  • 2 replies
  • 1 kudos

Databricks SQL Agent is failing

Goal :I want to build one Databricks SQL Agent using that any Databricks users can interact with a specified schema in Unity Catalog and generate insights on their data.Followed the url as reference :https://docs.databricks.com/en/large-language-mode...

  • 2999 Views
  • 2 replies
  • 1 kudos
Latest Reply
amaan784
New Contributor II
  • 1 kudos

Following up on @Walter_C insights, I encountered the same issue and wanted to share the complete steps I took to fully resolve the issue:1) Upgrade SQLAlchemy: Running the following command before any other code resolved the sqlalchemy.types error: ...

  • 1 kudos
1 More Replies
xisco891
by New Contributor II
  • 4849 Views
  • 5 replies
  • 1 kudos

Resolved! Github Repo linked to Generative AI with databricks

Hi guys, I would like to add the repo linked to the "Generative AI with Databricks" course. Do you know where I could find the repo with the notebooks that get shown in the demos in that course?. Best

  • 4849 Views
  • 5 replies
  • 1 kudos
Latest Reply
xisco891
New Contributor II
  • 1 kudos

Thanks!

  • 1 kudos
4 More Replies
test_user
by New Contributor II
  • 1174 Views
  • 1 replies
  • 0 kudos

test 123

testing

  • 1174 Views
  • 1 replies
  • 0 kudos
Latest Reply
Sujitha
Databricks Employee
  • 0 kudos

Are you facing issues creating a post @test_user ?

  • 0 kudos
tefrati
by New Contributor III
  • 2458 Views
  • 5 replies
  • 0 kudos

Is llama 3.0 not supported anymore or is it just a glitch

Hello all,For some reason, I can't find llama-3.0 models on either the playground or serving endpoints even though we've been using it for months.I can see both llama-3.1 models on the serving endpoints page and it also says they have been last modif...

  • 2458 Views
  • 5 replies
  • 0 kudos
Latest Reply
Sujitha
Databricks Employee
  • 0 kudos

@tefrati Thank you for your patience on this one! The pricing remains the same. Our team found version 3.1 to be better than 3 in many aspects, with the added benefit of not requiring any prompt changes. As a result, we have transitioned to 3.1. Our ...

  • 0 kudos
4 More Replies
sue01
by New Contributor II
  • 1179 Views
  • 1 replies
  • 0 kudos

ai_forecast function error

Hello,I am trying to forecast using ai_forecast function and I get this error (https://docs.databricks.com/en/sql/language-manual/functions/ai_forecast.html)I changed my cluster to use current channel yet this is not solved.. any idea why this occurs...

sue01_0-1724431017068.png
  • 1179 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @sue01 ,Make sure that you run it on clusters aligned with below recommendations:"Only available on Pro SQL warehouses running Databricks SQL version 2024.35 and above"

  • 0 kudos
mortenhaga2
by New Contributor III
  • 971 Views
  • 1 replies
  • 0 kudos

Monitoring Genie: Result not available from chat session

Hi!Have anyone experienced that you cant see the result of what Genie produced as an answer in the history of a chat session? How can I enable to view and correct historical answers for any Genie chat? 

Skjermbilde 2024-08-13 121630.jpg
Generative AI
Genie SQL AIBI AI
  • 971 Views
  • 1 replies
  • 0 kudos
Latest Reply
mortenhaga2
New Contributor III
  • 0 kudos

Anyone?

  • 0 kudos
Michael_Galli
by Contributor III
  • 5554 Views
  • 7 replies
  • 4 kudos

Resolved! SQL AI functions not working

I am working in the following environment:- New Databricks workspsace with UC enabled- Azure, region west-europe- Cluster: Interactive (DBR 15.4), or SQL Warehouse (Serverless)Running for example:SELECT ai_gen('Generate a concise, cheerful email titl...

  • 5554 Views
  • 7 replies
  • 4 kudos
Latest Reply
jessysantos
Databricks Employee
  • 4 kudos

Hello @Michael_Galli Sorry for the delay in my response. Unfortunately, only the two models you mentioned, Meta Llama 3.1 70B Instruct and GTE Large (En), are currently available in the EU Geo. Our team is working to make more models available soon f...

  • 4 kudos
6 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now