- 31379 Views
- 19 replies
- 37 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 31379 Views
- 19 replies
- 37 kudos
- 37 kudos
This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha
- 37 kudos
- 2462 Views
- 4 replies
- 1 kudos
Pydantic usage for structured output with provisioned LLM
Hi,I am looking for a resource that has examples of using Pydantic with a provisioned LLM on Databricks to get structured output.I can find many examples of using Pydantic with LLMs, but not on the Databricks.My use case is to extract text from image...
- 2462 Views
- 4 replies
- 1 kudos
- 2884 Views
- 4 replies
- 1 kudos
Resolved! Problem with Review App
I’m trying to deploy a Databricks Review App, but I’m running into the following error.Interestingly, the same code works fine when executed from a Databricks Notebook.Does anyone know what might be going wrong here? Could this be a bug with the Revi...
- 2884 Views
- 4 replies
- 1 kudos
- 1 kudos
I recently wrote a KB article on this. Let me know if this helps!TLDR: Databricks Apps are lightweight, container-based runtimes designed for UI rendering and light orchestration. They do not ship with an Apache Spark driver, executor, or JVM. Any ca...
- 1 kudos
- 3534 Views
- 5 replies
- 4 kudos
Prakash Hinduja Switzerland (Swiss) How do I build a RAG pipeline on Databricks?
Hello DataBricks Community,I'm Prakash Hinduja from Geneva, Switzerland (Swiss). As a financial strategist, I play an active role in strengthening the Swiss investment market. By connecting global investors with high-potential opportunities across Sw...
- 3534 Views
- 5 replies
- 4 kudos
- 4 kudos
@Khaja_Zaffer It's actually a weird type of spam - see simon-smart88/Hinduja_spam on GitHub. I've reported this post.
- 4 kudos
- 4367 Views
- 1 replies
- 0 kudos
How can we deploy a custom model
Goal:Let's say we have a custom function with arbitrary python code . And we want to deploy that as model as we wanted to generate an API endpoint .So that that can be accessed from external applications.I am attaching the below code I have tried .If...
- 4367 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @SandipCoder I believe that you are not seeing an output because you're calling the MLflow model via a REST API endpoint. MLflow’s REST API expects the inputs to be a DataFrame-like structure, not just a single string.Instead of passing this - {"i...
- 0 kudos
- 1690 Views
- 2 replies
- 3 kudos
Resolved! Can Genie ask clarifying questions?
I am looking for a way to force Genie to ask questions when an instruction is not entirely clear. Are there specific options or instructions that I could use for this, or is it managed internally by Databricks and we cannot adjust it?I would like Gen...
- 1690 Views
- 2 replies
- 3 kudos
- 3 kudos
Thanks @Vinay_M_R for the detailed explanation. It's good to know that Genie can ask clarifying questions.
- 3 kudos
- 3082 Views
- 7 replies
- 10 kudos
Resolved! Can Genie Space refer to any published dashboard? instead of table?
Can Genie Space refer to any published dashboard? instead of table?
- 3082 Views
- 7 replies
- 10 kudos
- 1387 Views
- 2 replies
- 1 kudos
Vector Search Indexes on dlt pipelines / materialized views
Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?
- 1387 Views
- 2 replies
- 1 kudos
- 1 kudos
Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...
- 1 kudos
- 1280 Views
- 2 replies
- 0 kudos
Resolved! Prakash Hinduja Geneva, Switzerland, How do I fine-tune a large language model (LLM) in Databricks?
Hello Databricks Community,I am Prakash Hinduja from Geneva, Switzerland (Swiss), currently exploring fine-tuning large language models (LLMs) in Databricks and would appreciate any guidance or suggestions from those with experience in this area. Reg...
- 1280 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @prakashhinduja can you acknowledge the solution provided because you keep on asking the same questions.
- 0 kudos
- 6385 Views
- 6 replies
- 6 kudos
Resolved! Databricks AI Genie - Data Security and Thrid Party Platform
I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...
- 6385 Views
- 6 replies
- 6 kudos
- 6 kudos
Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...
- 6 kudos
- 2024 Views
- 2 replies
- 2 kudos
Is it possible to run Databricks Genie entirely within a private network ?
We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?
- 2024 Views
- 2 replies
- 2 kudos
- 2 kudos
Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)
- 2 kudos
- 1443 Views
- 1 replies
- 1 kudos
Production Grade AI system with Agents capability in Databricks
Design AI System for Customer Sentiments Analysis with Agentic Bot.May someone please share how to architect such system in Databricks.Infrastructure on AzureData PipelineModel TrainingModel TestingChoosing Best ModelModel DeploymentModel ConsumtionP...
- 1443 Views
- 1 replies
- 1 kudos
- 1 kudos
hi @Pratikmsbsvm That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-ste...
- 1 kudos
- 1417 Views
- 2 replies
- 0 kudos
Couldn't fine claude 4 models on Databricks azure
Although it says they are available I couldn't fine them in databricks azure it's the same with https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-modelshttps://learn.microsoft.com/en-us/answers/questi...
- 1417 Views
- 2 replies
- 0 kudos
- 1503 Views
- 3 replies
- 0 kudos
Prakash Hinduja Switzerland (Swiss) How can I integrate Genie into my existing agent workflow?
Hi everyone,I am Prakash Hinduja from Geneva, Switzerland (Swiss) currently working on a generative AI project here in Switzerland and looking to enhance my agent workflow by integrating Databricks Genie as a tool or step in the pipeline.I have reall...
- 1503 Views
- 3 replies
- 0 kudos
- 0 kudos
You can also use the MCP managed servers to integrate Genie into Agents.https://www.linkedin.com/feed/update/urn:li:activity:7347865047525691393?utm_source=share&utm_medium=member_desktop&rcm=ACoAAEA0Q60BAjAJtu500ybsFv9jvw-qE2SMO1U
- 0 kudos
- 1927 Views
- 1 replies
- 1 kudos
Resolved! When would Google Gemini be available on Databricks Community Edition Playground?
https://www.databricks.com/company/newsroom/press-releases/databricks-announces-strategic-ai-partnership-google-cloud-bring#:~:text=Customers%20can%20pay%20for%20Gemini,founder%20and%20CEO%20of%20Databricks.
- 1927 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @Sharanya13! Google Gemini is not currently available on the Databricks Community Edition. The current focus is on enterprise and commercial integration, and no date or roadmap has been shared for availability on the Community or Free Edition p...
- 1 kudos
- 3120 Views
- 3 replies
- 4 kudos
Resolved! What is the difference between Databricks vector search vs Mosaic AI Vector Search?
What is the difference between Databricks Vector Search and Mosaic AI Vector Search?As I understand it, the core features of Databricks Vector Search have been integrated into Mosaic AI Vector Search. Does that mean Databricks Vector Search is a depr...
- 3120 Views
- 3 replies
- 4 kudos
- 4 kudos
thank you @Renu_ and @Sharanya13 for your explainations. Appreciate it!
- 4 kudos
