Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
Hi @hammad, Genie has its own APIs and cannot be served through Model Serving (creating a Model Serving Endpoint). All Genie queries happen in the context of a Genie Space even when accessed through the API. The Space is how Genie knows what data it ...
Hi All,In my organization, we use Databricks Connect and VS Code for data engineering purposes. This setup is working great, especially for:- Debugging- Unit tests- GitHub Copilot- Reusable modules and custom librariesIn my view, the developer experi...
Hello,I'm doing this-with mlflow.start_run(run_name="run1"):
logged_chain_info = mlflow.langchain.log_model(
# lc_model=os.path.join(os.getcwd(), 'full_chain'), this doesnt work too
lc_model='/Workspace/Users/{user_name}/exp/d...
I have followed below steps1) Created serving end point by for external model gpt-4-turbo and providing azure AI endpoint and key2) Now using langchain, i am trying to connect and invoke message from model in notebook model = ChatDatabricks(target_u...
I'm trying to use the AI generate feature to generate the comments for the table. Is there a way to accept all the comments at once instead of accepting each and every column one by one
Hi @Ranjith_V ,Unfortunately, as of now I don't think there is a way to do this. In UI there is no such an option, and REST API doesn't have any endpoint related to generating such comments. Probably this is something that will be added in the future...
All the tutorials I have seen about building a RAG within databricks involves using the Catalog option. For some reason my organization doesn't support that option and I can't use the unity catalog to build a RAG. Can I still use other features such ...
Hi @Aminsn, Having Unity Catalog enabled is a requirement for vector search. Source: Vector Search - Requirements. If you're referencing this tutorial Creating High Quality RAG Applications with Databricks I think that many of the required features a...
Hi, I have created an endpoint to return information from a RAG system, but when trying to be consumed by external apps, they got a CORS error because they are in a different domain and use javascript to call the API. How can I implement CORS in my e...
@Retired_mod My company is running into the same issue serving a model via REST API for a web application to call, and like @mcoffey I'm not able to see the CORs section after logging into the workspace as an admin and viewing the settings for the wo...
Summary"The Big Book of Generative AI from Databricks" provides a comprehensive guide to these critical questions and more, offering valuable insights into the tools and skills required for successful GenAI implementation. By addressing these questio...
Hi Guys,I had launched using our E2 Demo environment a 14.3 LTS ML Cluster (Scala 2.12), while executing the ClassRoom SetUp , I had facing multiple Exception.Even working my way with manually executing those scripts.Any Ideas on what could be wrong ...
Hi All,I need some urgent help. I have created an serving endpoint through below code. The code logs in pyfunc model that internally calls DBRX endpoint. However when i query using below input i always get same error. Can someone please help me with ...
Hello, I have a question regarding the new AI Comment generation feature. Is it possbile to use this feature without using the UI. Currently i have to accept every suggested comment one-by-one. Is there a feature / SQL or Phython Statement that i can...
I have few questions for which I am looking for answers in Databricks context. 1. Plagiarism and Originality How do we address the issue of plagiarism, where similar code, solutions, or documentation may be generated for similar prompts globally, p...
Thanks @Retired_mod I am looking for specific solutions on how this can be implemented in databricks for each of the above points. What tools/frameworks/functions can be used. I understand that it will depend on use cases but if you can take one exam...
In Gartner conference I heard about knowledge graph would be useful in giving better context to LLM models... haven't seen anyone actually talking about that angle. Any LLM guru's chime in with your views please?
Microsoft released a repo for Graph Rag, with a subrepo for aceleration using Azure infraestructure. Perhaps, Databricks working on Azure cloud may take advantage of the aceleration subrepo.https://microsoft.github.io/graphrag/
Hi @MaheshPS, great question, if not a little abstract. There are probably as many ways to measure the ROI of using DBRX as there are use cases for it, but let's try to focus on some more concrete examples.
If you use DBRX as part of an internal kno...