cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30414 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30414 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
dbx_beginner_10
by New Contributor II
  • 1216 Views
  • 2 replies
  • 1 kudos

Vector Search Indexes on dlt pipelines / materialized views

Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?

  • 1216 Views
  • 2 replies
  • 1 kudos
Latest Reply
dbx_beginner_10
New Contributor II
  • 1 kudos

Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...

  • 1 kudos
1 More Replies
prakashhinduja
by New Contributor III
  • 1165 Views
  • 2 replies
  • 0 kudos

Resolved! Prakash Hinduja Geneva, Switzerland, How do I fine-tune a large language model (LLM) in Databricks?

Hello Databricks Community,I am Prakash Hinduja from Geneva, Switzerland (Swiss), currently exploring fine-tuning large language models (LLMs) in Databricks and would appreciate any guidance or suggestions from those with experience in this area. Reg...

  • 1165 Views
  • 2 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello @prakashhinduja can you acknowledge the solution provided because you keep on asking the same questions.

  • 0 kudos
1 More Replies
ChrisChan
by New Contributor III
  • 5867 Views
  • 6 replies
  • 6 kudos

Resolved! Databricks AI Genie - Data Security and Thrid Party Platform

I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...

  • 5867 Views
  • 6 replies
  • 6 kudos
Latest Reply
k1chi
New Contributor II
  • 6 kudos

Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...

  • 6 kudos
5 More Replies
llIIlI1ll1II
by New Contributor III
  • 1902 Views
  • 2 replies
  • 2 kudos

Is it possible to run Databricks Genie entirely within a private network ?

We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?

  • 1902 Views
  • 2 replies
  • 2 kudos
Latest Reply
llIIlI1ll1II
New Contributor III
  • 2 kudos

Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)

  • 2 kudos
1 More Replies
Pratikmsbsvm
by Contributor
  • 1322 Views
  • 1 replies
  • 1 kudos

Production Grade AI system with Agents capability in Databricks

Design AI System for Customer Sentiments Analysis with Agentic Bot.May someone please share how to architect such system in Databricks.Infrastructure on AzureData PipelineModel TrainingModel TestingChoosing Best ModelModel DeploymentModel ConsumtionP...

  • 1322 Views
  • 1 replies
  • 1 kudos
Latest Reply
TheOC
Contributor III
  • 1 kudos

hi @Pratikmsbsvm That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-ste...

  • 1 kudos
thunder-07
by New Contributor II
  • 1318 Views
  • 2 replies
  • 0 kudos

Couldn't fine claude 4 models on Databricks azure

Although it says they are available I couldn't fine them in databricks azure it's the same with https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-modelshttps://learn.microsoft.com/en-us/answers/questi...

  • 1318 Views
  • 2 replies
  • 0 kudos
Latest Reply
thunder-07
New Contributor II
  • 0 kudos

@nayan_wylde It's a premium one.

  • 0 kudos
1 More Replies
prakashhinduja
by New Contributor III
  • 1402 Views
  • 3 replies
  • 0 kudos

Prakash Hinduja Switzerland (Swiss) How can I integrate Genie into my existing agent workflow?

Hi everyone,I am Prakash Hinduja from Geneva, Switzerland (Swiss) currently working on a generative AI project here in Switzerland and looking to enhance my agent workflow by integrating Databricks Genie as a tool or step in the pipeline.I have reall...

  • 1402 Views
  • 3 replies
  • 0 kudos
Latest Reply
Sharanya13
Contributor III
  • 0 kudos

You can also use the MCP managed servers to integrate Genie into Agents.https://www.linkedin.com/feed/update/urn:li:activity:7347865047525691393?utm_source=share&utm_medium=member_desktop&rcm=ACoAAEA0Q60BAjAJtu500ybsFv9jvw-qE2SMO1U

  • 0 kudos
2 More Replies
Sharanya13
by Contributor III
  • 1682 Views
  • 1 replies
  • 1 kudos

Resolved! When would Google Gemini be available on Databricks Community Edition Playground?

https://www.databricks.com/company/newsroom/press-releases/databricks-announces-strategic-ai-partnership-google-cloud-bring#:~:text=Customers%20can%20pay%20for%20Gemini,founder%20and%20CEO%20of%20Databricks.  

  • 1682 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @Sharanya13! Google Gemini is not currently available on the Databricks Community Edition. The current focus is on enterprise and commercial integration, and no date or roadmap has been shared for availability on the Community or Free Edition p...

  • 1 kudos
longht
by New Contributor II
  • 2794 Views
  • 3 replies
  • 4 kudos

Resolved! What is the difference between Databricks vector search vs Mosaic AI Vector Search?

What is the difference between Databricks Vector Search and Mosaic AI Vector Search?As I understand it, the core features of Databricks Vector Search have been integrated into Mosaic AI Vector Search. Does that mean Databricks Vector Search is a depr...

  • 2794 Views
  • 3 replies
  • 4 kudos
Latest Reply
longht
New Contributor II
  • 4 kudos

thank you @Renu_ and @Sharanya13 for your explainations. Appreciate it!

  • 4 kudos
2 More Replies
vedants
by New Contributor
  • 1657 Views
  • 1 replies
  • 0 kudos

Databricks MCP to VsCode

HelloI was hoping for some guidance on databricks MCP configuration?I understand it is in Beta release.I would like to understand- authenticating databricks with vscode- mcp server config to add in vscode

  • 1657 Views
  • 1 replies
  • 0 kudos
Latest Reply
charlie_wei
New Contributor III
  • 0 kudos

Connecting VS Code and GitHub Copilot to the Databricks Managed MCP Server 

  • 0 kudos
prakashhinduja
by New Contributor III
  • 1610 Views
  • 1 replies
  • 4 kudos

Resolved! Introduction of Prakash Hinduja Switzerland (Swiss)

Hi Everyone, I'm Prakash Hinduja from Geneva, Switzerland (Swiss), I'm a financial strategist with deep experience in both traditional and emerging markets, I help clients build and preserve wealth through high-impact strategies in sustainable energy...

  • 1610 Views
  • 1 replies
  • 4 kudos
Latest Reply
Advika
Databricks Employee
  • 4 kudos

Welcome to the community, @prakashhinduja, it's great to have you with us! As you explore the Community, be sure to check out the Technical Blogs, to explore in-depth articles and real-world use cases. If you have any technical questions, post them u...

  • 4 kudos
Malthe
by Contributor II
  • 1779 Views
  • 2 replies
  • 1 kudos

Resolved! View inheritance of table and column comments

Reading through the documentation and searching in the community forum, I'm getting conflicting information on how views might inherit table and column comments from the underlying tables in a Genie context.My question is, to what extent does Genie p...

  • 1779 Views
  • 2 replies
  • 1 kudos
Latest Reply
lingareddy_Alva
Honored Contributor III
  • 1 kudos

Hi @Malthe Based on the current understanding of Genie's behavior:Comment Inheritance in Genie ViewsWhat Genie typically inherits:- Column descriptions from underlying tables are often picked up automatically- Basic column metadata (data types, nulla...

  • 1 kudos
1 More Replies
sengkchu
by New Contributor III
  • 1465 Views
  • 2 replies
  • 1 kudos

Resolved! ProgramOfThought module in Dspy error in Databricks notebooks

This module uses deno, but even after installing it. I get a permissions error. Anyone encountered this before?Failed to run ProgramOfThought: [Errno 13] Permission denied: 'deno'

  • 1465 Views
  • 2 replies
  • 1 kudos
Latest Reply
sengkchu
New Contributor III
  • 1 kudos

Got it working @Renu_  I needed to add the permissions in my notebook as I am on serverless. import ospath = "/local_disk0/.ephemeral_nfs/envs/{Python_Env_instance}/bin/deno"os.chmod(path, 0o777)

  • 1 kudos
1 More Replies
ninicky
by New Contributor II
  • 1583 Views
  • 1 replies
  • 1 kudos

Is the basic model considering adding Claude 4 Opus?

Is the basic model considering adding Claude 4 Opus? It should be the strongest model in the world right now, and AWS already supports it.

  • 1583 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @ninicky, Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025.  Opus will be available in Databricks Mosaic AI as additional first-par...

  • 1 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now