cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 39246 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 39246 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
prakashhinduja
by New Contributor III
  • 4322 Views
  • 5 replies
  • 5 kudos

Prakash Hinduja Switzerland (Swiss) How do I build a RAG pipeline on Databricks?

Hello DataBricks Community,I'm Prakash Hinduja from Geneva, Switzerland (Swiss). As a financial strategist, I play an active role in strengthening the Swiss investment market. By connecting global investors with high-potential opportunities across Sw...

  • 4322 Views
  • 5 replies
  • 5 kudos
Latest Reply
simonsmart
New Contributor II
  • 5 kudos

@Khaja_Zaffer It's actually a weird type of spam - see simon-smart88/Hinduja_spam on GitHub. I've reported this post.

  • 5 kudos
4 More Replies
SandipCoder
by New Contributor II
  • 4906 Views
  • 1 replies
  • 0 kudos

How can we deploy a custom model

Goal:Let's say we have a custom function with arbitrary python code . And we want to deploy that as model as we wanted to generate an API endpoint .So that that can be accessed from external applications.I am attaching the below code I have tried .If...

Generative AI
GenAI
modelcreation
  • 4906 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vidhi_Khaitan
Databricks Employee
  • 0 kudos

Hi @SandipCoder I believe that you are not seeing an output because you're calling the MLflow model via a REST API endpoint. MLflow’s REST API expects the inputs to be a DataFrame-like structure, not just a single string.Instead of passing this - {"i...

  • 0 kudos
yvesbeutler
by New Contributor III
  • 3599 Views
  • 2 replies
  • 3 kudos

Resolved! Can Genie ask clarifying questions?

I am looking for a way to force Genie to ask questions when an instruction is not entirely clear. Are there specific options or instructions that I could use for this, or is it managed internally by Databricks and we cannot adjust it?I would like Gen...

  • 3599 Views
  • 2 replies
  • 3 kudos
Latest Reply
Sharanya13
Contributor III
  • 3 kudos

Thanks @Vinay_M_R for the detailed explanation. It's good to know that Genie can ask clarifying questions.

  • 3 kudos
1 More Replies
dbx_beginner_10
by New Contributor II
  • 2232 Views
  • 2 replies
  • 1 kudos

Vector Search Indexes on dlt pipelines / materialized views

Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?

  • 2232 Views
  • 2 replies
  • 1 kudos
Latest Reply
dbx_beginner_10
New Contributor II
  • 1 kudos

Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...

  • 1 kudos
1 More Replies
ChrisChan
by New Contributor III
  • 10525 Views
  • 6 replies
  • 6 kudos

Resolved! Databricks AI Genie - Data Security and Thrid Party Platform

I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...

  • 10525 Views
  • 6 replies
  • 6 kudos
Latest Reply
k1chi
New Contributor II
  • 6 kudos

Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...

  • 6 kudos
5 More Replies
llIIlI1ll1II
by New Contributor III
  • 2822 Views
  • 2 replies
  • 2 kudos

Is it possible to run Databricks Genie entirely within a private network ?

We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?

  • 2822 Views
  • 2 replies
  • 2 kudos
Latest Reply
llIIlI1ll1II
New Contributor III
  • 2 kudos

Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)

  • 2 kudos
1 More Replies
Pratikmsbsvm
by Contributor
  • 2155 Views
  • 1 replies
  • 1 kudos

Production Grade AI system with Agents capability in Databricks

Design AI System for Customer Sentiments Analysis with Agentic Bot.May someone please share how to architect such system in Databricks.Infrastructure on AzureData PipelineModel TrainingModel TestingChoosing Best ModelModel DeploymentModel ConsumtionP...

  • 2155 Views
  • 1 replies
  • 1 kudos
Latest Reply
TheOC
Databricks Partner
  • 1 kudos

hi @Pratikmsbsvm That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-ste...

  • 1 kudos
thunder-07
by New Contributor II
  • 1920 Views
  • 2 replies
  • 0 kudos

Couldn't fine claude 4 models on Databricks azure

Although it says they are available I couldn't fine them in databricks azure it's the same with https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-modelshttps://learn.microsoft.com/en-us/answers/questi...

  • 1920 Views
  • 2 replies
  • 0 kudos
Latest Reply
thunder-07
New Contributor II
  • 0 kudos

@nayan_wylde It's a premium one.

  • 0 kudos
1 More Replies
prakashhinduja
by New Contributor III
  • 2114 Views
  • 3 replies
  • 0 kudos

Prakash Hinduja Switzerland (Swiss) How can I integrate Genie into my existing agent workflow?

Hi everyone,I am Prakash Hinduja from Geneva, Switzerland (Swiss) currently working on a generative AI project here in Switzerland and looking to enhance my agent workflow by integrating Databricks Genie as a tool or step in the pipeline.I have reall...

  • 2114 Views
  • 3 replies
  • 0 kudos
Latest Reply
Sharanya13
Contributor III
  • 0 kudos

You can also use the MCP managed servers to integrate Genie into Agents.https://www.linkedin.com/feed/update/urn:li:activity:7347865047525691393?utm_source=share&utm_medium=member_desktop&rcm=ACoAAEA0Q60BAjAJtu500ybsFv9jvw-qE2SMO1U

  • 0 kudos
2 More Replies
Sharanya13
by Contributor III
  • 2606 Views
  • 1 replies
  • 1 kudos

Resolved! When would Google Gemini be available on Databricks Community Edition Playground?

https://www.databricks.com/company/newsroom/press-releases/databricks-announces-strategic-ai-partnership-google-cloud-bring#:~:text=Customers%20can%20pay%20for%20Gemini,founder%20and%20CEO%20of%20Databricks.  

  • 2606 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Community Manager
  • 1 kudos

Hello @Sharanya13! Google Gemini is not currently available on the Databricks Community Edition. The current focus is on enterprise and commercial integration, and no date or roadmap has been shared for availability on the Community or Free Edition p...

  • 1 kudos
longht
by New Contributor II
  • 5369 Views
  • 3 replies
  • 4 kudos

Resolved! What is the difference between Databricks vector search vs Mosaic AI Vector Search?

What is the difference between Databricks Vector Search and Mosaic AI Vector Search?As I understand it, the core features of Databricks Vector Search have been integrated into Mosaic AI Vector Search. Does that mean Databricks Vector Search is a depr...

  • 5369 Views
  • 3 replies
  • 4 kudos
Latest Reply
longht
New Contributor II
  • 4 kudos

thank you @Renu_ and @Sharanya13 for your explainations. Appreciate it!

  • 4 kudos
2 More Replies
vedants
by New Contributor
  • 3538 Views
  • 1 replies
  • 0 kudos

Databricks MCP to VsCode

HelloI was hoping for some guidance on databricks MCP configuration?I understand it is in Beta release.I would like to understand- authenticating databricks with vscode- mcp server config to add in vscode

  • 3538 Views
  • 1 replies
  • 0 kudos
Latest Reply
charlie_wei
New Contributor III
  • 0 kudos

Connecting VS Code and GitHub Copilot to the Databricks Managed MCP Server 

  • 0 kudos
prakashhinduja
by New Contributor III
  • 2089 Views
  • 1 replies
  • 4 kudos

Resolved! Introduction of Prakash Hinduja Switzerland (Swiss)

Hi Everyone, I'm Prakash Hinduja from Geneva, Switzerland (Swiss), I'm a financial strategist with deep experience in both traditional and emerging markets, I help clients build and preserve wealth through high-impact strategies in sustainable energy...

  • 2089 Views
  • 1 replies
  • 4 kudos
Latest Reply
Advika
Community Manager
  • 4 kudos

Welcome to the community, @prakashhinduja, it's great to have you with us! As you explore the Community, be sure to check out the Technical Blogs, to explore in-depth articles and real-world use cases. If you have any technical questions, post them u...

  • 4 kudos
Malthe
by Valued Contributor II
  • 3430 Views
  • 2 replies
  • 1 kudos

Resolved! View inheritance of table and column comments

Reading through the documentation and searching in the community forum, I'm getting conflicting information on how views might inherit table and column comments from the underlying tables in a Genie context.My question is, to what extent does Genie p...

  • 3430 Views
  • 2 replies
  • 1 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 1 kudos

Hi @Malthe Based on the current understanding of Genie's behavior:Comment Inheritance in Genie ViewsWhat Genie typically inherits:- Column descriptions from underlying tables are often picked up automatically- Basic column metadata (data types, nulla...

  • 1 kudos
1 More Replies
Labels