- 4067 Views
- 1 replies
- 0 kudos
Mlflow Import error
I am trying to deploy the latest mlFlow registry Model to Azure ML by following the article: https://www.databricks.com/notebooks/mlops/deploy_azure_ml_model_.htmlBut during the import process at cmd:6 . I am getting an error ModulenotFoundError No m...
- 4067 Views
- 1 replies
- 0 kudos
- 0 kudos
@Retired_mod Thank you, that solved the issue.But on proceeding with the execution, at the build image step, I faced another issue.''TypeError: join() argument must be str, bytes, or os.PathLike object, not 'dict''' .The model is registered successfu...
- 0 kudos
- 2106 Views
- 0 replies
- 0 kudos
MLFlow Recipes + Feature Store
Hi everyone,I am currently exploring MLFlow recipes, is there someone here who has already tried implementing MLFlow Recipes along with Databricks Feature Store? I am curious as to how you somehow defined the ingestion steps since I am unable to thin...
- 2106 Views
- 0 replies
- 0 kudos
- 3014 Views
- 1 replies
- 0 kudos
Creating or using a custom defined model with SpaCy
I want to train and use a custom model with spaCy. I don't know how to manage and create folders that the model would be need to save and load custom models and associated files (e.g. from DBFS)It should be something like this but it doesn't accept...
- 3014 Views
- 1 replies
- 0 kudos
- 3784 Views
- 0 replies
- 0 kudos
Data
To import an Excel file into Databricks, you can follow these general steps: 1. **Upload the Excel File**: - Go to the Databricks workspace or cluster where you want to work. - Navigate to the location where you want to upload the Excel file. - Click...
- 3784 Views
- 0 replies
- 0 kudos
- 1852 Views
- 1 replies
- 0 kudos
StackOverflow Error - FeatureLookup & fs.create_training_set
When trying to utilize feature_lookup on at least 2 feature tables and trying fs.create_training_set, I get a stackoverflow error. Can anyone help me understand why this happens? This hasn't happened before but now I get this error and I am unable to...
- 1852 Views
- 1 replies
- 0 kudos
- 2815 Views
- 2 replies
- 9 kudos
How to get list of all the tabular models in a Analysis server using databricks ?
Hello community, I want to fetch the list of all the tabular models (if possible details about those models too) which are there in a SQL Analysis server using databricks. Can anyone help me out ?Use case: I want to process clear a large number of mo...
- 2815 Views
- 2 replies
- 9 kudos
- 4329 Views
- 5 replies
- 5 kudos
Does FeatureStoreClient().score_batch support multidimentional predictions?
I have a pyfunc model that I can use to get predictions. It takes time series data with context information at each date, and produces a string of predictions. For example:The data is set up like below (temp/pressure/output are different than my inpu...
- 4329 Views
- 5 replies
- 5 kudos
- 5 kudos
I have the same question. I've decided to look for alternative Feature Stores as this makes it very difficult to use for time series forecasting.
- 5 kudos
- 2808 Views
- 0 replies
- 0 kudos
Notebook Langchain ModuleNotFoundError: No module named 'langchain.retrievers.merger_retriever'
Hi,As mentioned in the title, receiving this error despite%pip install --upgrade langchainSpecific line of code:from langchain.retrievers.merger_retriever import MergerRetriever All other langchain import works when this is commented out. Same line w...
- 2808 Views
- 0 replies
- 0 kudos
- 2128 Views
- 2 replies
- 1 kudos
Attach instance profile to Model serving endpoint
Hi all, I'm unable to attach an instance profile to a model serving end point. I followed the instructions on this page to update an existing model with an instance profile arn. I have verified the instance profile works by attaching it to a compute ...
- 2128 Views
- 2 replies
- 1 kudos
- 1364 Views
- 0 replies
- 0 kudos
Pandas options
Hi All,Per this post's suggestion:https://towardsdatascience.com/a-solution-for-inconsistencies-in-indexing-operations-in-pandas-b76e10719744 I put the following code in Databricks notebook:import pandas as pd pd.set_option('mode.copy_on_write', True...
- 1364 Views
- 0 replies
- 0 kudos
- 13096 Views
- 5 replies
- 2 kudos
Run one workflow dynamically with different parameter and schedule time.
Can we run one workflow for different parameters and different schedule time. so that only one workflow can executed for different parameters we do not have to create that workflow again and again. or we can say Is there any possibility to drive work...
- 13096 Views
- 5 replies
- 2 kudos
- 2 kudos
Update / Solved: Using CLI on Linux/MacOS: Send in the sample json with job_id in it. databricks jobs run-now --json '{ "job_id":<job-ID>, "notebook_params": { <key>:<value>, <key>:<value> }}' Using CLI on Windows: Send in the sample json w...
- 2 kudos
- 4142 Views
- 6 replies
- 1 kudos
Run a Databricks notebook from another notebook with ipywidget
0I am trying to run a notebook from another notebook using the dbutils.notebook.run as follows:import ipywidgets as widgetsfrom ipywidgets import interactfrom ipywidgets import Boxbutton = widgets.Button(description='Run model')out = widgets.Output()...
- 4142 Views
- 6 replies
- 1 kudos
- 1 kudos
As I could see the pyspark stream is not supporting this setContext, ideally it should have alternative approach. please suggest what is approach where pyspark stream is internally calling to another notebook parallel
- 1 kudos
- 1906 Views
- 1 replies
- 0 kudos
Mlflow Error in Databricks notebooks
Getting this error in experiments tab of databricks notebook.There was an error loading the runs. The experiment resource may no longer exist or you no longer have permission to access it. here is the code I am usingmlflow.tensorflow.autolog() with m...
- 1906 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @AmanJain1008,Thank you for posting your question in the Databricks Community.Could you kindly check whether you are able to reproduce the issue with the below code examples: # Import Libraries import pandas as pd import numpy as np import mlflow ...
- 0 kudos
- 5358 Views
- 4 replies
- 2 kudos
Resolved! How to load data using Sparklyr
Databricks Community New to Databricks, and R User and trying to figure out how to load a hive table via Sparklyr. The path to the file is https://databricks.xxx.xx.gov/#table/xxx_mydata/mydata_etl (right clicking on the file). I trieddata_tbl <- tb...
- 5358 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @JefferyReichman,Not sure that I completely understood your last question about "where I can read up on this for getting started". However, you can start by running this code in the Databricks community edition notebook.For more details: Link
- 2 kudos
- 6829 Views
- 1 replies
- 1 kudos
Resolved! Importing TensorFlow is giving an error when running ML model
Error stack trace:TypeError: Descriptors cannot not be created directly. If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0. If you cannot immediately regenerate your protos, some o...
- 6829 Views
- 1 replies
- 1 kudos
- 1 kudos
Please find the below resolution:Install a protobuf version >3.20 on the cluster. pinned the protobuf==3.20.1 on the Cluster librariesReference: https://github.com/tensorflow/tensorflow/issues/60320
- 1 kudos
