cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Kaizen
by Contributor III
  • 369 Views
  • 2 replies
  • 0 kudos

Model Serving Latency Chart

Hi, For the model serving latency graph what is p50 and p99? I only have one model i am serving on this endpoing so im surprised to see two models being tracked  

Kaizen_0-1714504038212.png
  • 369 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaizen
Contributor III
  • 0 kudos

If im not mistaken this refers to 50% of responses and 99% responses and averages accordingly for the metrics? @s_park @Sujitha @Debayan 

  • 0 kudos
1 More Replies
tanjil
by New Contributor III
  • 475 Views
  • 3 replies
  • 0 kudos

Import mlflow Error

Hello, I am trying to replicate this motebook in my environment: mlflow-end-to-end-example - Databricks However, I am getting the following error when I run "import mlflow": "TypeError: bases must be types"How can I solve this issue? Thank you, Tanji...

  • 475 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hello @tanjil    Thank you for contacting databricks community support. Could you check what version of protobuf you have? If you are using 10.4 ML cluster, the MLflow 1.x is not compatible with protobuf 4.x. The default version of protobuf in MLR 10...

  • 0 kudos
2 More Replies
yorabhir
by New Contributor II
  • 820 Views
  • 1 replies
  • 1 kudos

Resolved! 'error_code': 'INVALID_PARAMETER_VALUE', 'message': 'Too many sources. It cannot be more than 100'

I am getting the following error while saving a delta table in the feature storeWARNING databricks.feature_store._catalog_client_helper: Failed to record data sources in the catalog. Exception: {'error_code': 'INVALID_PARAMETER_VALUE', 'message': 'To...

  • 820 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @yorabhir,  Verify how many sources you’re trying to record in the catalog. If it exceeds 100, you’ll need to reduce the number of sources.Ensure that the feature table creation process is correctly configured. In your code snippet, you’re creatin...

  • 1 kudos
NaeemS
by New Contributor
  • 548 Views
  • 1 replies
  • 0 kudos

Handling Null Values in Feature Stores

Hi, I am using multiple feature stores in my workflow using feature lookups. In my logged pipeline, I have several stages, including Assembler, Standard Scaler, Indexer and then Model. However, I am facing an issue during inference using the `score b...

Machine Learning
Feature Store
  • 548 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @NaeemS , Handling null values in feature stores is crucial to ensure robustness and reliability in your machine learning pipelines. Let’s explore some strategies to address this issue: Custom Transformer Stage: You’ve already considered addin...

  • 0 kudos
AdamIH123
by New Contributor
  • 885 Views
  • 1 replies
  • 0 kudos

Feature Store Log Model and Score Batch - env_manager

Hi Everyone. I have a couple of questions about the feature store log model and score batch. After you log a model with the feature store then use fs.score_batch is it possible to pass the env_manager to predict with the same env as training as descr...

fs_score_batch.png
Machine Learning
feature_store
log_model
score_batch
  • 885 Views
  • 1 replies
  • 0 kudos
Latest Reply
MohsenJ
New Contributor III
  • 0 kudos

I also like to know if that works. 

  • 0 kudos
MohsenJ
by New Contributor III
  • 522 Views
  • 2 replies
  • 1 kudos

Model Lineage with Feature Engineering is missing tables and notebooks

I am trying to track the lineage of model and tables using the FeatureEngineeringClient. The table lineage shows the relevant tables and notebooks but the model lineage shows only the model. No notebook and tables. here is my code  fe = FeatureEngine...

  • 522 Views
  • 2 replies
  • 1 kudos
Latest Reply
MohsenJ
New Contributor III
  • 1 kudos

ok I realized something else. That although I used FeatureEngineeringCient, MLflow model artifact suggest I used FeatureStoreClient. Please see attachment.   

  • 1 kudos
1 More Replies
jonathan-dufaul
by Valued Contributor
  • 2006 Views
  • 5 replies
  • 5 kudos

Does FeatureStoreClient().score_batch support multidimentional predictions?

I have a pyfunc model that I can use to get predictions. It takes time series data with context information at each date, and produces a string of predictions. For example:The data is set up like below (temp/pressure/output are different than my inpu...

  • 2006 Views
  • 5 replies
  • 5 kudos
Latest Reply
EmilAndersson
New Contributor II
  • 5 kudos

I have the same question. I've decided to look for alternative Feature Stores as this makes it very difficult to use for time series forecasting.

  • 5 kudos
4 More Replies
Northp
by New Contributor II
  • 2124 Views
  • 2 replies
  • 2 kudos

Resolved! Differences between Feature Store and Unity Catalog

Our small team has just finished the data preparation phase of our project and started data analysis in Databricks. As we go deeper into this field, we're trying to understand the distinctions and appropriate uses for a Feature Store versus a Unity C...

  • 2124 Views
  • 2 replies
  • 2 kudos
Latest Reply
Vinay_M_R
Valued Contributor II
  • 2 kudos

Hi @Northp  Good day!1.)  A Feature Store is a centralized repository that enables data scientists to find and share features, ensuring that the same code used to compute the feature values is used for model training and inference. It is particularly...

  • 2 kudos
1 More Replies
Direo
by Contributor
  • 1491 Views
  • 3 replies
  • 2 kudos

Feature store feature table location

Can Databricks feature tables be stored outside of DBFS?

  • 1491 Views
  • 3 replies
  • 2 kudos
Latest Reply
the-sab
New Contributor II
  • 2 kudos

Yes, Databricks feature tables can be stored outside of Databricks File System (DBFS). You can store your feature tables in external storage systems such as Amazon S3, Azure Blob Storage, Azure Data Lake Storage, or Hadoop Distributed File System (HD...

  • 2 kudos
2 More Replies
animadurkar
by New Contributor III
  • 3094 Views
  • 2 replies
  • 2 kudos

Resolved! Invalid catalog and schema for table name error when creating a Feature Store

I've created a dataset that I want to create a feature store table for. I created a database in my dev unity catalog to store the feature tables, but each time I try to create the table I get this error:ValueError: Invalid catalog 'dev' or schema 'fe...

  • 3094 Views
  • 2 replies
  • 2 kudos
Latest Reply
Oogh5zai1
New Contributor II
  • 2 kudos

Hello,The error message suggests that there might be an issue with the catalog or schema name you are using when trying to create the feature store table. Here are a few tips to help you troubleshoot this problem:Verify the catalog and schema names: ...

  • 2 kudos
1 More Replies
thomasm
by New Contributor II
  • 1856 Views
  • 3 replies
  • 1 kudos

Resolved! Online Feature Store MLflow serving problem

When I try to serve a model stored with FeatureStoreClient().log_model using the feature-store-online-example-cosmosdb tutorial Notebook, I get errors suggesting that the primary key schema is not configured properly. However, if I look in the Featur...

  • 1856 Views
  • 3 replies
  • 1 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 1 kudos

Hello @Thomas Michielsen​ , this error seems to occur when you may have created the table yourself. You must use publish_table() to create the table in the online store. Do not manually create a database or container inside Cosmos DB. publish_table()...

  • 1 kudos
2 More Replies
Saeid_H
by Contributor
  • 3684 Views
  • 7 replies
  • 8 kudos

What are the practical advantage of Feature Store compared to Delta Lake?

Could someone explain the practical advantages of using a feature store vs. Delta Lake. apparently they both work in the same manner and the feature store does not provide additional value. However, based on the documentation on the databricks page, ...

  • 3684 Views
  • 7 replies
  • 8 kudos
Latest Reply
Anonymous
Not applicable
  • 8 kudos

Hi @Saeid Hedayati​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...

  • 8 kudos
6 More Replies
Saeid_H
by Contributor
  • 3171 Views
  • 5 replies
  • 5 kudos

How to change the feature store delta table default path on DBFS?

Hi everyone,Would it be possible to change the default storage path of deature store, during creation and/or after creation? If you could also provide the python script to that I would appreciate. The current default path is:"dbfs/user/hive/warehouse...

  • 3171 Views
  • 5 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Saeid Hedayati​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...

  • 5 kudos
4 More Replies
zachclem
by New Contributor III
  • 2294 Views
  • 2 replies
  • 1 kudos

Resolved! Logging model to MLflow using Feature Store API. Getting TypeError: join() argument must be str, bytes, or os.PathLike object, not 'dict'

I'm using databricks. Trying to log a model to MLflow using the Feature Store log_model function. but I have this error: TypeError: join() argument must be str, bytes, or os.PathLike object, not 'dict' I'am using the Databricks runtime ml (10.4 LTS M...

  • 2294 Views
  • 2 replies
  • 1 kudos
Latest Reply
zachclem
New Contributor III
  • 1 kudos

I updated by Databricks Run Time from 10.4 to 12.1 and this solved the issue.

  • 1 kudos
1 More Replies
youssefmrini
by Honored Contributor III
  • 617 Views
  • 1 replies
  • 1 kudos
  • 617 Views
  • 1 replies
  • 1 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 1 kudos

Yes You can. With Databricks Runtime 12.2 LTS ML and above, you can use existing feature tables in Feature Store to augment the original input dataset for all of your AutoML problems: classification, regression, and forecasting.This capability requi...

  • 1 kudos
Labels