cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 37509 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 37509 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
Muhammad_Umer
by New Contributor III
  • 15202 Views
  • 1 replies
  • 3 kudos

Genie Space

How can I export/share a Genie space across different workspace environments such as DEV,QA, and PROD etc.# Genie

  • 15202 Views
  • 1 replies
  • 3 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 3 kudos

You would use Git Folders (Run Git operations on Databricks Git folders (Repos) | Databricks on AWS).  In my environment, it doesn't appear to be supported yet.  You can create a Genie space in a Git Folder at this time, but you get this alert: 

  • 3 kudos
bryan1
by New Contributor III
  • 4776 Views
  • 7 replies
  • 1 kudos

Customizing the UI of Streamlit App Template

Hi There,I used the Streamlit Chatbot template for Databricks Apps. I'm looking to customize the UI and wanted to make changes to the app.py file to do so. Even before I made any changes, I ran the file and I'm getting an error with databricks SDK an...

bryan1_0-1736647332600.png
  • 4776 Views
  • 7 replies
  • 1 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 1 kudos

Hi @bryan1, Thanks for the details, there might be something at the cluster level configuration, can you please share your cluster settings like DBR version / libraries / access mode? I even tried on an older version / serverless and worked:  

  • 1 kudos
6 More Replies
jericksoncea
by New Contributor III
  • 11401 Views
  • 11 replies
  • 2 kudos

Help with Databricks vector search index advanced metadata filtering

I have been able to successfully implement a Databricks vector search index with metadata filtering (How to create and query a vector search index | Databricks on AWS).However, I am facing a challenge when implementing a more advanced filtering mecha...

  • 11401 Views
  • 11 replies
  • 2 kudos
Latest Reply
Walter_C
Databricks Employee
  • 2 kudos

sure, happy to help, let us know in case you have additional questions

  • 2 kudos
10 More Replies
infinitylearnin
by New Contributor III
  • 949 Views
  • 0 replies
  • 0 kudos

Role of Data practitioner in AI Era

As the AI revolution takes off in 2025, there is a renewed emphasis on adopting a Data-First approach. Organizations are increasingly recognizing the need to establish a robust data foundation while preparing a skilled fleet of Data Engineers to tack...

  • 949 Views
  • 0 replies
  • 0 kudos
txti
by New Contributor III
  • 5997 Views
  • 7 replies
  • 1 kudos

Resolved! Importing LanceDB Library Crashes Python Driver

Hello, I am unable to import the LanceDB library.My environment is configured as follows:Single Node of type g4dn.xlargeDBR 16.1 ML for GPUCode to Reproduce: %pip install lancedb==0.17.0 dbutils.library.restartPython() # Crashes on import import lan...

  • 5997 Views
  • 7 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

Hello @victor58 thanks for your question, on your case lets start with validations based on KB https://kb.databricks.com/en_US/clusters/python-kernel-is-unresponsive-error-message 

  • 1 kudos
6 More Replies
mortenhaga
by Contributor
  • 35065 Views
  • 2 replies
  • 1 kudos

Databricks Genie

Hi allWe have just started a little mini project on using Genie and up until now, our experience is very positive. Therefore, Im interested in more documentation and learning materials other than what Databricks officially has (https://docs.databrick...

  • 35065 Views
  • 2 replies
  • 1 kudos
Latest Reply
Databricks_AI
New Contributor II
  • 1 kudos

Hi @mortenhaga , since we are also looking for the same approach, is there a way that you found out or is there any reply which helped you to figure out the above problem?

  • 1 kudos
1 More Replies
javieryw
by New Contributor
  • 1826 Views
  • 1 replies
  • 0 kudos

Error Calling Llama Guard Model from Databricks Marketplace after deploying the model

I am facing issues calling the Llama Guard Model after deploying it to Model Serving on Databricks.  I deployed the model by requesting instant access from Databricks Marketplace and deployed it to Model Serving.I am following the code examples here:...

  • 1826 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

@javieryw, The error you are encountering, "400 Client Error: Bad Request for url:  https://westus.azuredatabricks.net/serving-endpoints/llama-guard/invocations. Response text: Bad request: json: unknown field 'dataframe_split'", indicates that the p...

  • 0 kudos
Anureka
by New Contributor II
  • 3657 Views
  • 3 replies
  • 1 kudos

Gen AI Fundamentals Badge

I'm trying to take the quiz and get the badge for Gen AI Fundamentals, but unfortunately unable to do so as the login credentials aren't letting me in. Please advice where to find the link to take the quiz here.

  • 3657 Views
  • 3 replies
  • 1 kudos
Latest Reply
priiyankapj91
New Contributor II
  • 1 kudos

I'm trying to take the quiz and get the badge for Gen AI Fundamentals, but unfortunately unable to do so as the login credentials aren't letting me in. Please advice where to find the link to take the quiz here.  

  • 1 kudos
2 More Replies
bk073
by New Contributor
  • 1085 Views
  • 1 replies
  • 0 kudos

Unable to query foundation model

I was trying to run a query on the foundational model using the example given in the document. - https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html But I am getting errors. Is it the issue with the version or t...

  • 1085 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Can you share the error message that you are receiving?

  • 0 kudos
kanks987
by New Contributor
  • 2615 Views
  • 2 replies
  • 0 kudos

Assistance with Combined Filters in Databricks Vector Store Index

 Hi,I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.My index contains the following columns: product_category, product_date, and description.Question 1: How can I re...

  • 2615 Views
  • 2 replies
  • 0 kudos
Latest Reply
altaysaid
New Contributor II
  • 0 kudos

How do we do multiple filters? for example I want to filter a vector store by two columns with an AND logic.

  • 0 kudos
1 More Replies
akinakinbiyi
by New Contributor III
  • 7589 Views
  • 5 replies
  • 4 kudos

Accessing Databricks Lab Materials

Hello Databrick Support,Why is it so complex to get access to the Lab Materials after subscription. Each time I tried accessing this materials, it show a message stating "The Course has ended and no longer accessible". If this message is accurate, wh...

  • 7589 Views
  • 5 replies
  • 4 kudos
Latest Reply
jmichaelbryan
New Contributor II
  • 4 kudos

Did this ever get resolved? I was taking the course and then stopped for a month or so to focus on other things. Now that I'm back, I can't see the labs from within the course.

  • 4 kudos
4 More Replies
Rafael2
by New Contributor
  • 4650 Views
  • 1 replies
  • 0 kudos

Preventing Genie from Returning Empty Tables as Responses

Hello! I am implementing the use of a Genie Room in my company. During development, we are encountering several situations where Genie returns an empty table.I understand that an empty table is always an error—either due to a mistake in the user's qu...

  • 4650 Views
  • 1 replies
  • 0 kudos
Latest Reply
Takuya-Omi
Valued Contributor III
  • 0 kudos

I found this to be a very interesting approach.One important point to consider is that an empty result can also carry meaning. With this in mind, I provided the following instructions to Genie:When a user's query results in an empty table, first dete...

  • 0 kudos
maltasa
by New Contributor II
  • 1766 Views
  • 1 replies
  • 0 kudos

Large datasets in Databricks

How can I efficiently handle large datasets in Databricks when performing group-by operations to avoid out-of-memory errors? Are there any best practices or optimizations for improving performance, such as partitioning or caching, especially when wor...

  • 1766 Views
  • 1 replies
  • 0 kudos
Latest Reply
Takuya-Omi
Valued Contributor III
  • 0 kudos

Hi, @maltasa I believe this article might help answer your question.Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads 

  • 0 kudos
Sujitha
by Databricks Employee
  • 2346 Views
  • 1 replies
  • 2 kudos

Insights from a global survey of 1,100 technologists and interviews with 28 CIOs

How to unlock enterprise AI: “You can have all the AI in the world, but if it’s on a shaky data foundation, then it’s not going to bring you any value.” — Carol Clements, Chief Digital and Technology Officer, JetBlue Companies everywhere have been qu...

Screenshot 2024-11-15 at 3.52.14 AM.png
  • 2346 Views
  • 1 replies
  • 2 kudos
Latest Reply
Ajay-Pandey
Databricks MVP
  • 2 kudos

Must read

  • 2 kudos
llmnerd
by New Contributor
  • 2023 Views
  • 1 replies
  • 1 kudos

DataBricks Foundational model rate limiting approach

Hi there,is this the correct approach to fulfil the rate limit restrictions in the foundational model API?from langchain_core.rate_limiters import InMemoryRateLimiter rate_limiter = InMemoryRateLimiter( requests_per_second=2.0, check_every_...

  • 2023 Views
  • 1 replies
  • 1 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 1 kudos

Hello @llmnerd, Yes, the approach you have outlined to fulfill the rate limit restrictions in the foundational model API using InMemoryRateLimiter from langchain_core appears to be correct. This setup should help you manage the rate limits effectivel...

  • 1 kudos