- 1762 Views
- 1 replies
- 0 kudos
Identity Resolution
Looking for best solutions for identity resolution. I already have deterministic matching. Exploring probabilistic solutions. Any advice for me?
- 1762 Views
- 1 replies
- 0 kudos
- 0 kudos
Recommend checking out Amperity. Listed on Databricks marketplace, support delta sharing and unity catalog. Patented AI approach to ID resolution https://docs.amperity.com/stitch.html
- 0 kudos
- 2849 Views
- 1 replies
- 0 kudos
Resolved! Github Datasets/Labs for Large Language Models: Application through Production is not working
I've signed up for the module for certification on Large Language Models: Application through Production.Follow the Github instructions and install the notebooks provided.Unfortunately none of the workbooks are working due to the- Badly setup file pa...
- 2849 Views
- 1 replies
- 0 kudos
- 0 kudos
No further instructions on the Read-me here: https://github.com/databricks-academy/large-language-models/tree/publishedFollowed all the setup steps, but the file paths in /include are not working fine.Why does not Databricks provide the direct links ...
- 0 kudos
- 2142 Views
- 0 replies
- 0 kudos
Create Serving Endpoint with JAVA Runtime
Hello,Trying to create a custom serving endpoint, using artifacts argument while logging the run/model to save .jar files. These files are called during when calling .predict. JAVA runtime 8 or higher is required to run the jar file, not sure how to ...
- 2142 Views
- 0 replies
- 0 kudos
- 2809 Views
- 0 replies
- 1 kudos
Handling Null Values in Feature Stores
Hi, I am using multiple feature stores in my workflow using feature lookups. In my logged pipeline, I have several stages, including Assembler, Standard Scaler, Indexer and then Model. However, I am facing an issue during inference using the `score b...
- 2809 Views
- 0 replies
- 1 kudos
- 5407 Views
- 2 replies
- 1 kudos
Customize mail notification from Databricks workflow
Hi All,Can we customize the mail subject and body that we receive from Azure Databricks workflow upon failure jobs? Kindly help me, if we can do so.Thanks,Moshe
- 5407 Views
- 2 replies
- 1 kudos
- 1 kudos
I have three workspaces and the alerts sent by the jobs running are not referencing the workspace for example. So if I run the job to dev environemnt I get an alert like if the job has been executed from the prod. This si a huge issue for our admins....
- 1 kudos
- 4773 Views
- 3 replies
- 1 kudos
InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering ...
Running a python function in the notebook, i am getting the following InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering `/databricks/python_shell/scripts/db_ipykernel_launcher.py configure`When i try to run...
- 4773 Views
- 3 replies
- 1 kudos
- 1 kudos
Facing the same issuefor me the error comes up when mlflow.get_experiment_by_name is called.I am running a custom docker image built on databricksruntime/standard:13.3-LTScustom image so my packages are installed.
- 1 kudos
- 5581 Views
- 0 replies
- 0 kudos
MLOPS retraining
https://docs.databricks.com/en/machine-learning/mlops/mlops-workflow.html#7-retrainingIn this article, it is mentioned that we can trigger retraining from the alerts.Triggered. If the monitoring pipeline can identify model performance issues and send...
- 5581 Views
- 0 replies
- 0 kudos
- 19760 Views
- 5 replies
- 0 kudos
Resolved! Download model artifacts from MLflow
I am trying to find a way to locally download the model artifacts that build a chatbot chain registered with MLflow in Databricks, so that I can preserve the whole structure (chain -> model -> steps -> yaml & pkl files).There is a mention in a contri...
- 19760 Views
- 5 replies
- 0 kudos
- 0 kudos
OK, eventually I found a solution. I write it below, whether somebody will need it. Basically, if in the download_artifacts method the local directory is an existing and accessible one in the DBFS, the process will work as expected.import os # Con...
- 0 kudos
- 2716 Views
- 1 replies
- 0 kudos
mlflow.exceptions.MlflowException - Invalid metric 'refreshableTokenNotFound'
Hi,We are facing an mlflow.exceptions.MlflowException when mlflow is called from stream,when we load the model outside the stream, its loaded fine, while when we load it from within stream it fails with exception. to emphasize that it was working til...
- 2716 Views
- 1 replies
- 0 kudos
- 0 kudos
Downgrade to version 13.3 did the trick
- 0 kudos
- 3976 Views
- 1 replies
- 1 kudos
Errors using Dolly Deployed as a REST API
We have deployed Dolly (https://huggingface.co/databricks/dolly-v2-3b) as a REST API endpoint on our infrastructure. The notebook we used to do this is included in the text below my question.The Databricks infra used had the following config - (13.2...
- 3976 Views
- 1 replies
- 1 kudos
- 1 kudos
I had a similar problem when I used HuggingFacePipeline(pipeline=generate_text) with langchain. It worked to me when I tried to use HuggingFaceHub instead. I used the same dolly-3b model.
- 1 kudos
- 3555 Views
- 1 replies
- 0 kudos
Resolved! 0: 'error: TypeError("\'NoneType\' object is not callable") in api_request_parallel_processor.py
I´m facing this exception after use mlflow.langchain.log_model and test the logged model using the following commandprint(loaded_model.predict([{"query": "how does the performance of llama 2 compare to other local LLMs?"}]))tasks failed. Errors: {0: ...
- 3555 Views
- 1 replies
- 0 kudos
- 0 kudos
I verified all steps @Retired_mod and the objects and structure were looking good. As far as I understood on tests. Langchain Rag features such as RetrievalQA.from_chain_type does not work well with llm = HuggingFacePipeline instantiation steps. The...
- 0 kudos
- 1981 Views
- 2 replies
- 0 kudos
Input training dataset field empty in Configure AutoML experiment
Trying to start an ML experiment on data in an extant metastore within a catalogue (SQL querys run fine on the database). I can start an ML cluster, then attempt to start an AutoML expirement but I get stuck selecting training data - there are no da...
- 1981 Views
- 2 replies
- 0 kudos
- 0 kudos
you can read SQL data to DataFrame and run AutoML in the notebookTrain ML models with Databricks AutoML Python API | Databricks on AWS
- 0 kudos
- 2649 Views
- 2 replies
- 0 kudos
Upgrading cuDNN on Databricks notebook
I'm trying to upgrade Tensorflow version from 2.8 to 2.13 on Databricks notebook that is attached to a cluster with Databricks Runtime 10.4. How can I upgrade cuDNN from 8.0 to at least 8.6 to be compatible with the Tensorflow new version?
- 2649 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod , Thanks for your response. When I run '!conda list cudnn' on databricks notebook, I get the following error: '/bin/bash: conda: command not found'
- 0 kudos
- 2688 Views
- 0 replies
- 0 kudos
OutOfMemoryError: CUDA out of memory on LLM Finetuning
I am trying to finetune llama2_lora model using the xTuring library, while facing this error. (batch size is 1). I am working on a cluster having 1 Worker (28 GB Memory, 4 Cores) and 1 Driver (110 GB Memory, 16 Cores). I am facing this error: OutOfMe...
- 2688 Views
- 0 replies
- 0 kudos
- 2214 Views
- 0 replies
- 0 kudos
Error in Tensorflow training job
I upgraded Tensorflow on Databricks notebook using %pip command. Now when running the training job, I get this error: "DNN library initialization failed."
- 2214 Views
- 0 replies
- 0 kudos
