- 10144 Views
- 6 replies
- 6 kudos
Displaying graphviz images in a notebook
Hi,I'm experimenting with process mining in a Databricks notebook using the OSS library PM4PY. I've been working through some tutorials and the notebook they provide on Github:https://github.com/pm4py/pm4py-core/blob/release/notebooks/3_process_disco...
- 10144 Views
- 6 replies
- 6 kudos
- 6 kudos
@Rob_S i am also in the same situation the code cell executes but no visualization how did you tackle this problem?
- 6 kudos
- 3698 Views
- 1 replies
- 0 kudos
parallel execution with applyinpandas on partitioned table
Hi,I have a job that uses df.groupby(“Country”).applyInPandas(..) to run pandas-based hyperparameter tuning in parallel for 6 countries.It runs on a cluster with 4 workers (Chosen like this because the countries’ datasets are of different sizes – so ...
- 3698 Views
- 1 replies
- 0 kudos
- 7220 Views
- 5 replies
- 2 kudos
Serving API endpoint failing
Hi Team,I registered my ML model in databricks but while trying to serve an API endpoint for the model it is failing with the following error logs.Service logs: There are currently no replicas in a running state.Build logs :Build never started - chec...
- 7220 Views
- 5 replies
- 2 kudos
- 2 kudos
@ombhuyan We currently only upload logs during the build phase to the user (i.e where we install the pip dependencies) but we don't upload logs during the pre-build phase (i.e where we download the model). That's why you may not see clear error messa...
- 2 kudos
- 8770 Views
- 6 replies
- 3 kudos
Databricks Notebook Rendering Issue: IPython.lib.display.IFrame
Similar issue here: https://stackoverflow.com/questions/71336374/randomforestclassifier-explainer-dashboard-output-in-databricks-notebook-is-notActual output – Databricks Notebook Expected Output – Jupyter Notebook Reproducible Code Example#pip insta...
- 8770 Views
- 6 replies
- 3 kudos
- 3 kudos
Hi Abhishek, I followed your steps, I am having in identifying the dashboard link. How do I figure out the first two words dbc-dp- for my cluster?
- 3 kudos
- 1278 Views
- 1 replies
- 0 kudos
Identity Resolution
Looking for best solutions for identity resolution. I already have deterministic matching. Exploring probabilistic solutions. Any advice for me?
- 1278 Views
- 1 replies
- 0 kudos
- 0 kudos
Recommend checking out Amperity. Listed on Databricks marketplace, support delta sharing and unity catalog. Patented AI approach to ID resolution https://docs.amperity.com/stitch.html
- 0 kudos
- 2318 Views
- 1 replies
- 0 kudos
Resolved! Github Datasets/Labs for Large Language Models: Application through Production is not working
I've signed up for the module for certification on Large Language Models: Application through Production.Follow the Github instructions and install the notebooks provided.Unfortunately none of the workbooks are working due to the- Badly setup file pa...
- 2318 Views
- 1 replies
- 0 kudos
- 0 kudos
No further instructions on the Read-me here: https://github.com/databricks-academy/large-language-models/tree/publishedFollowed all the setup steps, but the file paths in /include are not working fine.Why does not Databricks provide the direct links ...
- 0 kudos
- 1625 Views
- 0 replies
- 0 kudos
Create Serving Endpoint with JAVA Runtime
Hello,Trying to create a custom serving endpoint, using artifacts argument while logging the run/model to save .jar files. These files are called during when calling .predict. JAVA runtime 8 or higher is required to run the jar file, not sure how to ...
- 1625 Views
- 0 replies
- 0 kudos
- 2074 Views
- 0 replies
- 1 kudos
Handling Null Values in Feature Stores
Hi, I am using multiple feature stores in my workflow using feature lookups. In my logged pipeline, I have several stages, including Assembler, Standard Scaler, Indexer and then Model. However, I am facing an issue during inference using the `score b...
- 2074 Views
- 0 replies
- 1 kudos
- 4414 Views
- 2 replies
- 1 kudos
Customize mail notification from Databricks workflow
Hi All,Can we customize the mail subject and body that we receive from Azure Databricks workflow upon failure jobs? Kindly help me, if we can do so.Thanks,Moshe
- 4414 Views
- 2 replies
- 1 kudos
- 1 kudos
I have three workspaces and the alerts sent by the jobs running are not referencing the workspace for example. So if I run the job to dev environemnt I get an alert like if the job has been executed from the prod. This si a huge issue for our admins....
- 1 kudos
- 3766 Views
- 3 replies
- 1 kudos
InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering ...
Running a python function in the notebook, i am getting the following InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering `/databricks/python_shell/scripts/db_ipykernel_launcher.py configure`When i try to run...
- 3766 Views
- 3 replies
- 1 kudos
- 1 kudos
Facing the same issuefor me the error comes up when mlflow.get_experiment_by_name is called.I am running a custom docker image built on databricksruntime/standard:13.3-LTScustom image so my packages are installed.
- 1 kudos
- 4951 Views
- 0 replies
- 0 kudos
MLOPS retraining
https://docs.databricks.com/en/machine-learning/mlops/mlops-workflow.html#7-retrainingIn this article, it is mentioned that we can trigger retraining from the alerts.Triggered. If the monitoring pipeline can identify model performance issues and send...
- 4951 Views
- 0 replies
- 0 kudos
- 14959 Views
- 5 replies
- 0 kudos
Resolved! Download model artifacts from MLflow
I am trying to find a way to locally download the model artifacts that build a chatbot chain registered with MLflow in Databricks, so that I can preserve the whole structure (chain -> model -> steps -> yaml & pkl files).There is a mention in a contri...
- 14959 Views
- 5 replies
- 0 kudos
- 0 kudos
OK, eventually I found a solution. I write it below, whether somebody will need it. Basically, if in the download_artifacts method the local directory is an existing and accessible one in the DBFS, the process will work as expected.import os # Con...
- 0 kudos
- 2088 Views
- 1 replies
- 0 kudos
mlflow.exceptions.MlflowException - Invalid metric 'refreshableTokenNotFound'
Hi,We are facing an mlflow.exceptions.MlflowException when mlflow is called from stream,when we load the model outside the stream, its loaded fine, while when we load it from within stream it fails with exception. to emphasize that it was working til...
- 2088 Views
- 1 replies
- 0 kudos
- 0 kudos
Downgrade to version 13.3 did the trick
- 0 kudos
- 2656 Views
- 1 replies
- 1 kudos
Errors using Dolly Deployed as a REST API
We have deployed Dolly (https://huggingface.co/databricks/dolly-v2-3b) as a REST API endpoint on our infrastructure. The notebook we used to do this is included in the text below my question.The Databricks infra used had the following config - (13.2...
- 2656 Views
- 1 replies
- 1 kudos
- 1 kudos
I had a similar problem when I used HuggingFacePipeline(pipeline=generate_text) with langchain. It worked to me when I tried to use HuggingFaceHub instead. I used the same dolly-3b model.
- 1 kudos
- 2503 Views
- 1 replies
- 0 kudos
Resolved! 0: 'error: TypeError("\'NoneType\' object is not callable") in api_request_parallel_processor.py
I´m facing this exception after use mlflow.langchain.log_model and test the logged model using the following commandprint(loaded_model.predict([{"query": "how does the performance of llama 2 compare to other local LLMs?"}]))tasks failed. Errors: {0: ...
- 2503 Views
- 1 replies
- 0 kudos
- 0 kudos
I verified all steps @Retired_mod and the objects and structure were looking good. As far as I understood on tests. Langchain Rag features such as RetrievalQA.from_chain_type does not work well with llm = HuggingFacePipeline instantiation steps. The...
- 0 kudos
