- 29935 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29935 Views
- 18 replies
- 33 kudos
- 1207 Views
- 2 replies
- 0 kudos
Sentiment analysis using GEN AI
Has someone started a sentiment analysis in customer surveys using gen AI? How was the experience?
- 1207 Views
- 2 replies
- 0 kudos
- 0 kudos
@Vini_Coin I recently did a sentiment analysis on a table and used the AI function ai_analyze_sentiment in databricks it was very simple without needing to write a model or long code. here is the doc if you want to refer.https://learn.microsoft.com/e...
- 0 kudos
- 1563 Views
- 1 replies
- 1 kudos
Chatbot Deployment Error on Databricks
Hi All,I am trying to deploy a chatbot on databricks and I get this error in the build log:Build could not start due to an internal error. If you are serving a model from UC and Azure storage firewall or Private Link is configured on your storage acc...
- 1563 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi team,The underlying cause of this issue is an incorrect Network Connectivity Configuration (NCC) for Azure Storage in the Databricks environment. The NCC determines which resources are accessible from within the Databricks environment. If the NCC ...
- 1 kudos
- 4182 Views
- 1 replies
- 0 kudos
DatabricksFunctionClient : PERMISSION_DENIED when creating the client
Hello, I'm currently working with Databricks features to create an AI agent system. In the documentation it's written that the library DatabricksFunctionClient is needed to register custom tools to UC. I followed the different steps from the explana...
- 4182 Views
- 1 replies
- 0 kudos
- 0 kudos
My bet would be the cluster type that you are using. Did you try using serverless cluster? Quickstart - Unity Catalog
- 0 kudos
- 495 Views
- 0 replies
- 0 kudos
Newbie Dario Schiraldi, CEO of Travel Works
Hello Community, Hi, I’m Dario Schiraldi, CEO of Travel Works. I’m excited to join the Databricks community to connect with innovators who are shaping the future of data and AI. I’m here to learn, contribute, and collaborate around scalable data solu...
- 495 Views
- 0 replies
- 0 kudos
- 1780 Views
- 4 replies
- 1 kudos
Pydantic usage for structured output with provisioned LLM
Hi,I am looking for a resource that has examples of using Pydantic with a provisioned LLM on Databricks to get structured output.I can find many examples of using Pydantic with LLMs, but not on the Databricks.My use case is to extract text from image...
- 1780 Views
- 4 replies
- 1 kudos
- 2495 Views
- 4 replies
- 1 kudos
Resolved! Problem with Review App
I’m trying to deploy a Databricks Review App, but I’m running into the following error.Interestingly, the same code works fine when executed from a Databricks Notebook.Does anyone know what might be going wrong here? Could this be a bug with the Revi...
- 2495 Views
- 4 replies
- 1 kudos
- 1 kudos
I recently wrote a KB article on this. Let me know if this helps!TLDR: Databricks Apps are lightweight, container-based runtimes designed for UI rendering and light orchestration. They do not ship with an Apache Spark driver, executor, or JVM. Any ca...
- 1 kudos
- 29935 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29935 Views
- 18 replies
- 33 kudos
- 3309 Views
- 5 replies
- 4 kudos
Prakash Hinduja Switzerland (Swiss) How do I build a RAG pipeline on Databricks?
Hello DataBricks Community,I'm Prakash Hinduja from Geneva, Switzerland (Swiss). As a financial strategist, I play an active role in strengthening the Swiss investment market. By connecting global investors with high-potential opportunities across Sw...
- 3309 Views
- 5 replies
- 4 kudos
- 4 kudos
@Khaja_Zaffer It's actually a weird type of spam - see simon-smart88/Hinduja_spam on GitHub. I've reported this post.
- 4 kudos
- 4234 Views
- 1 replies
- 0 kudos
How can we deploy a custom model
Goal:Let's say we have a custom function with arbitrary python code . And we want to deploy that as model as we wanted to generate an API endpoint .So that that can be accessed from external applications.I am attaching the below code I have tried .If...
- 4234 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @SandipCoder I believe that you are not seeing an output because you're calling the MLflow model via a REST API endpoint. MLflow’s REST API expects the inputs to be a DataFrame-like structure, not just a single string.Instead of passing this - {"i...
- 0 kudos
- 1357 Views
- 2 replies
- 3 kudos
Resolved! Can Genie ask clarifying questions?
I am looking for a way to force Genie to ask questions when an instruction is not entirely clear. Are there specific options or instructions that I could use for this, or is it managed internally by Databricks and we cannot adjust it?I would like Gen...
- 1357 Views
- 2 replies
- 3 kudos
- 3 kudos
Thanks @Vinay_M_R for the detailed explanation. It's good to know that Genie can ask clarifying questions.
- 3 kudos
- 2704 Views
- 7 replies
- 10 kudos
Resolved! Can Genie Space refer to any published dashboard? instead of table?
Can Genie Space refer to any published dashboard? instead of table?
- 2704 Views
- 7 replies
- 10 kudos
- 1147 Views
- 2 replies
- 1 kudos
Vector Search Indexes on dlt pipelines / materialized views
Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?
- 1147 Views
- 2 replies
- 1 kudos
- 1 kudos
Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...
- 1 kudos
- 1120 Views
- 2 replies
- 0 kudos
Resolved! Prakash Hinduja Geneva, Switzerland, How do I fine-tune a large language model (LLM) in Databricks?
Hello Databricks Community,I am Prakash Hinduja from Geneva, Switzerland (Swiss), currently exploring fine-tuning large language models (LLMs) in Databricks and would appreciate any guidance or suggestions from those with experience in this area. Reg...
- 1120 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @prakashhinduja can you acknowledge the solution provided because you keep on asking the same questions.
- 0 kudos
- 5609 Views
- 6 replies
- 6 kudos
Resolved! Databricks AI Genie - Data Security and Thrid Party Platform
I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...
- 5609 Views
- 6 replies
- 6 kudos
- 6 kudos
Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...
- 6 kudos
- 1814 Views
- 2 replies
- 2 kudos
Is it possible to run Databricks Genie entirely within a private network ?
We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?
- 1814 Views
- 2 replies
- 2 kudos
- 2 kudos
Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)
- 2 kudos
