- 18679 Views
- 13 replies
- 20 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 18679 Views
- 13 replies
- 20 kudos
- 844 Views
- 0 replies
- 0 kudos
Accessing UC Volumes using pure python (ML) with databricks-connect
Hi All,In my organization, we use Databricks Connect and VS Code for data engineering purposes. This setup is working great, especially for:- Debugging- Unit tests- GitHub Copilot- Reusable modules and custom librariesIn my view, the developer experi...
- 844 Views
- 0 replies
- 0 kudos
- 629 Views
- 0 replies
- 0 kudos
Unable to add dependencies to mlflow.langchain.log_model
Hello,I'm doing this-with mlflow.start_run(run_name="run1"): logged_chain_info = mlflow.langchain.log_model( # lc_model=os.path.join(os.getcwd(), 'full_chain'), this doesnt work too lc_model='/Workspace/Users/{user_name}/exp/d...
- 629 Views
- 0 replies
- 0 kudos
- 1464 Views
- 0 replies
- 0 kudos
How can we serve Genie as an endpoint model like RAG?
Is there any way to serve genie bot as a endpoint model like we serve RAG models. So we can access the genie bot outside the genie space?
- 1464 Views
- 0 replies
- 0 kudos
- 683 Views
- 0 replies
- 0 kudos
Not able to invoke model external model
I have followed below steps1) Created serving end point by for external model gpt-4-turbo and providing azure AI endpoint and key2) Now using langchain, i am trying to connect and invoke message from model in notebook model = ChatDatabricks(target_u...
- 683 Views
- 0 replies
- 0 kudos
- 1875 Views
- 1 replies
- 1 kudos
Unity Catalog AI Generate for Column comments
I'm trying to use the AI generate feature to generate the comments for the table. Is there a way to accept all the comments at once instead of accepting each and every column one by one
- 1875 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Ranjith_V ,Unfortunately, as of now I don't think there is a way to do this. In UI there is no such an option, and REST API doesn't have any endpoint related to generating such comments. Probably this is something that will be added in the future...
- 1 kudos
- 2320 Views
- 3 replies
- 4 kudos
Resolved! Building RAG without Catalog
All the tutorials I have seen about building a RAG within databricks involves using the Catalog option. For some reason my organization doesn't support that option and I can't use the unity catalog to build a RAG. Can I still use other features such ...
- 2320 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @Aminsn, Having Unity Catalog enabled is a requirement for vector search. Source: Vector Search - Requirements. If you're referencing this tutorial Creating High Quality RAG Applications with Databricks I think that many of the required features a...
- 4 kudos
- 2463 Views
- 3 replies
- 3 kudos
CORS - Endpoint issue with CORS
Hi, I have created an endpoint to return information from a RAG system, but when trying to be consumed by external apps, they got a CORS error because they are in a different domain and use javascript to call the API. How can I implement CORS in my e...
- 2463 Views
- 3 replies
- 3 kudos
- 3 kudos
@Retired_mod My company is running into the same issue serving a model via REST API for a web application to call, and like @mcoffey I'm not able to see the CORs section after logging into the workspace as an admin and viewing the settings for the wo...
- 3 kudos
- 1577 Views
- 0 replies
- 1 kudos
Review of the First 20 Pages of "The Big Book of Generative AI from Databricks"
Summary"The Big Book of Generative AI from Databricks" provides a comprehensive guide to these critical questions and more, offering valuable insights into the tools and skills required for successful GenAI implementation. By addressing these questio...
- 1577 Views
- 0 replies
- 1 kudos
- 397 Views
- 0 replies
- 0 kudos
Encountering Error While Launching the Generative AI Associate course Labs
Hi Guys,I had launched using our E2 Demo environment a 14.3 LTS ML Cluster (Scala 2.12), while executing the ClassRoom SetUp , I had facing multiple Exception.Even working my way with manually executing those scripts.Any Ideas on what could be wrong ...
- 397 Views
- 0 replies
- 0 kudos
- 636 Views
- 0 replies
- 0 kudos
Not able to query serving endpoint thr UI consisting of logged pyfunc model calling DBRX endpoint
Hi All,I need some urgent help. I have created an serving endpoint through below code. The code logs in pyfunc model that internally calls DBRX endpoint. However when i query using below input i always get same error. Can someone please help me with ...
- 636 Views
- 0 replies
- 0 kudos
- 5432 Views
- 0 replies
- 0 kudos
GAI Lab practice
Hi DBs Team, Do you have lab environment for GAI assignments practice?How can I subscribe to it? Regards,Nitin Kapse
- 5432 Views
- 0 replies
- 0 kudos
- 922 Views
- 0 replies
- 0 kudos
Automate AI comment generation for columns
Hello, I have a question regarding the new AI Comment generation feature. Is it possbile to use this feature without using the UI. Currently i have to accept every suggested comment one-by-one. Is there a feature / SQL or Phython Statement that i can...
- 922 Views
- 0 replies
- 0 kudos
- 995 Views
- 1 replies
- 0 kudos
Gen AI governance and compliance
I have few questions for which I am looking for answers in Databricks context. 1. Plagiarism and Originality How do we address the issue of plagiarism, where similar code, solutions, or documentation may be generated for similar prompts globally, p...
- 995 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks @Retired_mod I am looking for specific solutions on how this can be implemented in databricks for each of the above points. What tools/frameworks/functions can be used. I understand that it will depend on use cases but if you can take one exam...
- 0 kudos
- 2536 Views
- 2 replies
- 1 kudos
Any advantage with knowledge graphs in RAG + LLM use cases?
In Gartner conference I heard about knowledge graph would be useful in giving better context to LLM models... haven't seen anyone actually talking about that angle. Any LLM guru's chime in with your views please?
- 2536 Views
- 2 replies
- 1 kudos
- 1 kudos
Microsoft released a repo for Graph Rag, with a subrepo for aceleration using Azure infraestructure. Perhaps, Databricks working on Azure cloud may take advantage of the aceleration subrepo.https://microsoft.github.io/graphrag/
- 1 kudos
- 1073 Views
- 1 replies
- 0 kudos
DBRX: Associating ROI of any implementation
Hi, how can one go about assessing the value created due to the implementation of DBRX?
- 1073 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @MaheshPS, great question, if not a little abstract. There are probably as many ways to measure the ROI of using DBRX as there are use cases for it, but let's try to focus on some more concrete examples. If you use DBRX as part of an internal kno...
- 0 kudos
