cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 29057 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 29057 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
yvesbeutler
by New Contributor III
  • 1267 Views
  • 2 replies
  • 3 kudos

Resolved! Can Genie ask clarifying questions?

I am looking for a way to force Genie to ask questions when an instruction is not entirely clear. Are there specific options or instructions that I could use for this, or is it managed internally by Databricks and we cannot adjust it?I would like Gen...

  • 1267 Views
  • 2 replies
  • 3 kudos
Latest Reply
Sharanya13
Contributor III
  • 3 kudos

Thanks @Vinay_M_R for the detailed explanation. It's good to know that Genie can ask clarifying questions.

  • 3 kudos
1 More Replies
dbx_beginner_10
by New Contributor II
  • 1075 Views
  • 2 replies
  • 1 kudos

Vector Search Indexes on dlt pipelines / materialized views

Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?

  • 1075 Views
  • 2 replies
  • 1 kudos
Latest Reply
dbx_beginner_10
New Contributor II
  • 1 kudos

Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...

  • 1 kudos
1 More Replies
prakashhinduja
by New Contributor III
  • 1071 Views
  • 2 replies
  • 0 kudos

Resolved! Prakash Hinduja Geneva, Switzerland, How do I fine-tune a large language model (LLM) in Databricks?

Hello Databricks Community,I am Prakash Hinduja from Geneva, Switzerland (Swiss), currently exploring fine-tuning large language models (LLMs) in Databricks and would appreciate any guidance or suggestions from those with experience in this area. Reg...

  • 1071 Views
  • 2 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello @prakashhinduja can you acknowledge the solution provided because you keep on asking the same questions.

  • 0 kudos
1 More Replies
ChrisChan
by New Contributor III
  • 5322 Views
  • 6 replies
  • 6 kudos

Resolved! Databricks AI Genie - Data Security and Thrid Party Platform

I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...

  • 5322 Views
  • 6 replies
  • 6 kudos
Latest Reply
k1chi
New Contributor II
  • 6 kudos

Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...

  • 6 kudos
5 More Replies
llIIlI1ll1II
by New Contributor III
  • 1750 Views
  • 2 replies
  • 2 kudos

Is it possible to run Databricks Genie entirely within a private network ?

We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?

  • 1750 Views
  • 2 replies
  • 2 kudos
Latest Reply
llIIlI1ll1II
New Contributor III
  • 2 kudos

Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)

  • 2 kudos
1 More Replies
Pratikmsbsvm
by Contributor
  • 996 Views
  • 1 replies
  • 1 kudos

Production Grade AI system with Agents capability in Databricks

Design AI System for Customer Sentiments Analysis with Agentic Bot.May someone please share how to architect such system in Databricks.Infrastructure on AzureData PipelineModel TrainingModel TestingChoosing Best ModelModel DeploymentModel ConsumtionP...

  • 996 Views
  • 1 replies
  • 1 kudos
Latest Reply
TheOC
Contributor III
  • 1 kudos

hi @Pratikmsbsvm That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-ste...

  • 1 kudos
thunder-07
by New Contributor II
  • 1216 Views
  • 2 replies
  • 0 kudos

Couldn't fine claude 4 models on Databricks azure

Although it says they are available I couldn't fine them in databricks azure it's the same with https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-modelshttps://learn.microsoft.com/en-us/answers/questi...

  • 1216 Views
  • 2 replies
  • 0 kudos
Latest Reply
thunder-07
New Contributor II
  • 0 kudos

@nayan_wylde It's a premium one.

  • 0 kudos
1 More Replies
prakashhinduja
by New Contributor III
  • 1299 Views
  • 3 replies
  • 0 kudos

Prakash Hinduja Switzerland (Swiss) How can I integrate Genie into my existing agent workflow?

Hi everyone,I am Prakash Hinduja from Geneva, Switzerland (Swiss) currently working on a generative AI project here in Switzerland and looking to enhance my agent workflow by integrating Databricks Genie as a tool or step in the pipeline.I have reall...

  • 1299 Views
  • 3 replies
  • 0 kudos
Latest Reply
Sharanya13
Contributor III
  • 0 kudos

You can also use the MCP managed servers to integrate Genie into Agents.https://www.linkedin.com/feed/update/urn:li:activity:7347865047525691393?utm_source=share&utm_medium=member_desktop&rcm=ACoAAEA0Q60BAjAJtu500ybsFv9jvw-qE2SMO1U

  • 0 kudos
2 More Replies
Sharanya13
by Contributor III
  • 1538 Views
  • 1 replies
  • 1 kudos

Resolved! When would Google Gemini be available on Databricks Community Edition Playground?

https://www.databricks.com/company/newsroom/press-releases/databricks-announces-strategic-ai-partnership-google-cloud-bring#:~:text=Customers%20can%20pay%20for%20Gemini,founder%20and%20CEO%20of%20Databricks.  

  • 1538 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @Sharanya13! Google Gemini is not currently available on the Databricks Community Edition. The current focus is on enterprise and commercial integration, and no date or roadmap has been shared for availability on the Community or Free Edition p...

  • 1 kudos
longht
by New Contributor II
  • 2546 Views
  • 3 replies
  • 4 kudos

Resolved! What is the difference between Databricks vector search vs Mosaic AI Vector Search?

What is the difference between Databricks Vector Search and Mosaic AI Vector Search?As I understand it, the core features of Databricks Vector Search have been integrated into Mosaic AI Vector Search. Does that mean Databricks Vector Search is a depr...

  • 2546 Views
  • 3 replies
  • 4 kudos
Latest Reply
longht
New Contributor II
  • 4 kudos

thank you @Renu_ and @Sharanya13 for your explainations. Appreciate it!

  • 4 kudos
2 More Replies
vedants
by New Contributor
  • 1389 Views
  • 1 replies
  • 0 kudos

Databricks MCP to VsCode

HelloI was hoping for some guidance on databricks MCP configuration?I understand it is in Beta release.I would like to understand- authenticating databricks with vscode- mcp server config to add in vscode

  • 1389 Views
  • 1 replies
  • 0 kudos
Latest Reply
charlie_wei
New Contributor III
  • 0 kudos

Connecting VS Code and GitHub Copilot to the Databricks Managed MCP Server 

  • 0 kudos
prakashhinduja
by New Contributor III
  • 1524 Views
  • 1 replies
  • 4 kudos

Resolved! Introduction of Prakash Hinduja Switzerland (Swiss)

Hi Everyone, I'm Prakash Hinduja from Geneva, Switzerland (Swiss), I'm a financial strategist with deep experience in both traditional and emerging markets, I help clients build and preserve wealth through high-impact strategies in sustainable energy...

  • 1524 Views
  • 1 replies
  • 4 kudos
Latest Reply
Advika
Databricks Employee
  • 4 kudos

Welcome to the community, @prakashhinduja, it's great to have you with us! As you explore the Community, be sure to check out the Technical Blogs, to explore in-depth articles and real-world use cases. If you have any technical questions, post them u...

  • 4 kudos
Malthe
by Contributor
  • 1646 Views
  • 2 replies
  • 1 kudos

Resolved! View inheritance of table and column comments

Reading through the documentation and searching in the community forum, I'm getting conflicting information on how views might inherit table and column comments from the underlying tables in a Genie context.My question is, to what extent does Genie p...

  • 1646 Views
  • 2 replies
  • 1 kudos
Latest Reply
lingareddy_Alva
Honored Contributor III
  • 1 kudos

Hi @Malthe Based on the current understanding of Genie's behavior:Comment Inheritance in Genie ViewsWhat Genie typically inherits:- Column descriptions from underlying tables are often picked up automatically- Basic column metadata (data types, nulla...

  • 1 kudos
1 More Replies
sengkchu
by New Contributor III
  • 1349 Views
  • 2 replies
  • 1 kudos

Resolved! ProgramOfThought module in Dspy error in Databricks notebooks

This module uses deno, but even after installing it. I get a permissions error. Anyone encountered this before?Failed to run ProgramOfThought: [Errno 13] Permission denied: 'deno'

  • 1349 Views
  • 2 replies
  • 1 kudos
Latest Reply
sengkchu
New Contributor III
  • 1 kudos

Got it working @Renu_  I needed to add the permissions in my notebook as I am on serverless. import ospath = "/local_disk0/.ephemeral_nfs/envs/{Python_Env_instance}/bin/deno"os.chmod(path, 0o777)

  • 1 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now