- 1318 Views
- 2 replies
- 1 kudos
Model Lineage with Feature Engineering is missing tables and notebooks
I am trying to track the lineage of model and tables using the FeatureEngineeringClient. The table lineage shows the relevant tables and notebooks but the model lineage shows only the model. No notebook and tables. here is my code fe = FeatureEngine...
- 1318 Views
- 2 replies
- 1 kudos
- 1 kudos
ok I realized something else. That although I used FeatureEngineeringCient, MLflow model artifact suggest I used FeatureStoreClient. Please see attachment.
- 1 kudos
- 7918 Views
- 6 replies
- 6 kudos
Displaying graphviz images in a notebook
Hi,I'm experimenting with process mining in a Databricks notebook using the OSS library PM4PY. I've been working through some tutorials and the notebook they provide on Github:https://github.com/pm4py/pm4py-core/blob/release/notebooks/3_process_disco...
- 7918 Views
- 6 replies
- 6 kudos
- 6 kudos
@Rob_S i am also in the same situation the code cell executes but no visualization how did you tackle this problem?
- 6 kudos
- 2712 Views
- 1 replies
- 0 kudos
parallel execution with applyinpandas on partitioned table
Hi,I have a job that uses df.groupby(“Country”).applyInPandas(..) to run pandas-based hyperparameter tuning in parallel for 6 countries.It runs on a cluster with 4 workers (Chosen like this because the countries’ datasets are of different sizes – so ...
- 2712 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,I have a job that uses df.groupby(“Country”).applyInPandas(..) to run pandas-based hyperparameter tuning in parallel for 6 countries.It runs on a cluster with 4 workers (Chosen like this because the countries’ datasets are of different sizes – so ...
- 0 kudos
- 5388 Views
- 5 replies
- 2 kudos
Serving API endpoint failing
Hi Team,I registered my ML model in databricks but while trying to serve an API endpoint for the model it is failing with the following error logs.Service logs: There are currently no replicas in a running state.Build logs :Build never started - chec...
- 5388 Views
- 5 replies
- 2 kudos
- 2 kudos
@ombhuyan We currently only upload logs during the build phase to the user (i.e where we install the pip dependencies) but we don't upload logs during the pre-build phase (i.e where we download the model). That's why you may not see clear error messa...
- 2 kudos
- 7021 Views
- 6 replies
- 3 kudos
Databricks Notebook Rendering Issue: IPython.lib.display.IFrame
Similar issue here: https://stackoverflow.com/questions/71336374/randomforestclassifier-explainer-dashboard-output-in-databricks-notebook-is-notActual output – Databricks Notebook Expected Output – Jupyter Notebook Reproducible Code Example#pip insta...
- 7021 Views
- 6 replies
- 3 kudos
- 3 kudos
Hi Abhishek, I followed your steps, I am having in identifying the dashboard link. How do I figure out the first two words dbc-dp- for my cluster?
- 3 kudos
- 983 Views
- 1 replies
- 0 kudos
Identity Resolution
Looking for best solutions for identity resolution. I already have deterministic matching. Exploring probabilistic solutions. Any advice for me?
- 983 Views
- 1 replies
- 0 kudos
- 0 kudos
Recommend checking out Amperity. Listed on Databricks marketplace, support delta sharing and unity catalog. Patented AI approach to ID resolution https://docs.amperity.com/stitch.html
- 0 kudos
- 1932 Views
- 1 replies
- 0 kudos
Resolved! Github Datasets/Labs for Large Language Models: Application through Production is not working
I've signed up for the module for certification on Large Language Models: Application through Production.Follow the Github instructions and install the notebooks provided.Unfortunately none of the workbooks are working due to the- Badly setup file pa...
- 1932 Views
- 1 replies
- 0 kudos
- 0 kudos
No further instructions on the Read-me here: https://github.com/databricks-academy/large-language-models/tree/publishedFollowed all the setup steps, but the file paths in /include are not working fine.Why does not Databricks provide the direct links ...
- 0 kudos
- 1332 Views
- 0 replies
- 0 kudos
Create Serving Endpoint with JAVA Runtime
Hello,Trying to create a custom serving endpoint, using artifacts argument while logging the run/model to save .jar files. These files are called during when calling .predict. JAVA runtime 8 or higher is required to run the jar file, not sure how to ...
- 1332 Views
- 0 replies
- 0 kudos
- 1583 Views
- 0 replies
- 0 kudos
Handling Null Values in Feature Stores
Hi, I am using multiple feature stores in my workflow using feature lookups. In my logged pipeline, I have several stages, including Assembler, Standard Scaler, Indexer and then Model. However, I am facing an issue during inference using the `score b...
- 1583 Views
- 0 replies
- 0 kudos
- 3421 Views
- 2 replies
- 1 kudos
Customize mail notification from Databricks workflow
Hi All,Can we customize the mail subject and body that we receive from Azure Databricks workflow upon failure jobs? Kindly help me, if we can do so.Thanks,Moshe
- 3421 Views
- 2 replies
- 1 kudos
- 1 kudos
I have three workspaces and the alerts sent by the jobs running are not referencing the workspace for example. So if I run the job to dev environemnt I get an alert like if the job has been executed from the prod. This si a huge issue for our admins....
- 1 kudos
- 2927 Views
- 3 replies
- 1 kudos
InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering ...
Running a python function in the notebook, i am getting the following InvalidConfigurationError: You haven't configured the CLI yet! Please configure by entering `/databricks/python_shell/scripts/db_ipykernel_launcher.py configure`When i try to run...
- 2927 Views
- 3 replies
- 1 kudos
- 1 kudos
Facing the same issuefor me the error comes up when mlflow.get_experiment_by_name is called.I am running a custom docker image built on databricksruntime/standard:13.3-LTScustom image so my packages are installed.
- 1 kudos
- 4588 Views
- 0 replies
- 0 kudos
MLOPS retraining
https://docs.databricks.com/en/machine-learning/mlops/mlops-workflow.html#7-retrainingIn this article, it is mentioned that we can trigger retraining from the alerts.Triggered. If the monitoring pipeline can identify model performance issues and send...
- 4588 Views
- 0 replies
- 0 kudos
- 10105 Views
- 5 replies
- 0 kudos
Resolved! Download model artifacts from MLflow
I am trying to find a way to locally download the model artifacts that build a chatbot chain registered with MLflow in Databricks, so that I can preserve the whole structure (chain -> model -> steps -> yaml & pkl files).There is a mention in a contri...
- 10105 Views
- 5 replies
- 0 kudos
- 0 kudos
OK, eventually I found a solution. I write it below, whether somebody will need it. Basically, if in the download_artifacts method the local directory is an existing and accessible one in the DBFS, the process will work as expected.import os # Con...
- 0 kudos
- 1577 Views
- 1 replies
- 0 kudos
mlflow.exceptions.MlflowException - Invalid metric 'refreshableTokenNotFound'
Hi,We are facing an mlflow.exceptions.MlflowException when mlflow is called from stream,when we load the model outside the stream, its loaded fine, while when we load it from within stream it fails with exception. to emphasize that it was working til...
- 1577 Views
- 1 replies
- 0 kudos
- 0 kudos
Downgrade to version 13.3 did the trick
- 0 kudos
- 2221 Views
- 1 replies
- 1 kudos
Errors using Dolly Deployed as a REST API
We have deployed Dolly (https://huggingface.co/databricks/dolly-v2-3b) as a REST API endpoint on our infrastructure. The notebook we used to do this is included in the text below my question.The Databricks infra used had the following config - (13.2...
- 2221 Views
- 1 replies
- 1 kudos
- 1 kudos
I had a similar problem when I used HuggingFacePipeline(pipeline=generate_text) with langchain. It worked to me when I tried to use HuggingFaceHub instead. I used the same dolly-3b model.
- 1 kudos
