- 5256 Views
- 2 replies
- 1 kudos
Resolved! Logging model to MLflow using Feature Store API. Getting TypeError: join() argument must be str, bytes, or os.PathLike object, not 'dict'
I'm using databricks. Trying to log a model to MLflow using the Feature Store log_model function. but I have this error: TypeError: join() argument must be str, bytes, or os.PathLike object, not 'dict' I'am using the Databricks runtime ml (10.4 LTS M...
- 5256 Views
- 2 replies
- 1 kudos
- 1 kudos
I updated by Databricks Run Time from 10.4 to 12.1 and this solved the issue.
- 1 kudos
- 1597 Views
- 1 replies
- 1 kudos
- 1597 Views
- 1 replies
- 1 kudos
- 1 kudos
Yes You can. With Databricks Runtime 12.2 LTS ML and above, you can use existing feature tables in Feature Store to augment the original input dataset for all of your AutoML problems: classification, regression, and forecasting.This capability requi...
- 1 kudos
- 3143 Views
- 3 replies
- 3 kudos
Is it possible to access online feature store (Cosmos DB) outside databricks?
We are building an machine learning application with feature store enabled. Once the model is built, we are trying to move the model artifacts and deploy it in azure ml as online endpoint. Does it possible to access the online store in azure ml endpo...
- 3143 Views
- 3 replies
- 3 kudos
- 3 kudos
if you want databricks to use the feature store, which is in Cosmos DB, yes, it is possible https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/online-feature-storessuppose you want to consume a future store in Databrick...
- 3 kudos
- 3596 Views
- 3 replies
- 2 kudos
Cannot write Feature Table because of invalid access token
From a notebook I created a new feature store via:%sql CREATE DATABASE IF NOT EXISTS feature_store_ebp;Within that feature store I fill my table with:feature_store_name = "feature_store_ebp.table_1" try: fs.write_table( name=feature_stor...
- 3596 Views
- 3 replies
- 2 kudos
- 16057 Views
- 5 replies
- 6 kudos
Resolved! Security exception while using Feature Store. How can I get this whitelisted?
I was following the Databricks Academy "New Capabilities Overview: Feature Store" module. However when I try to run the code in the example notebook I get a security exception as explained below. When I try to run the example notebook "01-Populate a ...
- 16057 Views
- 5 replies
- 6 kudos
- 6 kudos
Hi @Daniel Barrundia​ - please select "No isolation shared" Access mode, it should resolve this problem.
- 6 kudos
- 2212 Views
- 2 replies
- 3 kudos
Streaming Source for Feature Store (and outputMode)
To save computing resource and time, can I use streaming source in a batch mode (similar to Auto Loader) to update my feature store as my source table receives row update or is appended with new rows?
- 2212 Views
- 2 replies
- 3 kudos
- 12613 Views
- 10 replies
- 12 kudos
Resolved! Delete feature tables through the Python API
The documentation explains how to delete feature tables through the UI. Is it possible to do the same using the Python FeatureStoreClient? I cannot find anything in the docs: https://docs.databricks.com/_static/documents/feature-store-python-api-refe...
- 12613 Views
- 10 replies
- 12 kudos
- 12 kudos
from databricks import feature_store fs = feature_store.FeatureStoreClient() fs.drop_table(FEATURE_TABLE_NAME)As of Databricks Runtime 10.5 for ML. Docs
- 12 kudos
- 4331 Views
- 1 replies
- 4 kudos
Databricks MLOps Best Practices
Where to find the best practices on MLOps on DatabricksWe recommend checking out the Big Book of MLOps for detailed guidance on MLOps best practices on Databricks including reference architectures.For a deep dive on the Databricks Feature store, we r...
- 4331 Views
- 1 replies
- 4 kudos
- 4 kudos
you can check here https://docs.databricks.com/machine-learning/mlops/mlops-workflow.html
- 4 kudos
- 7085 Views
- 7 replies
- 15 kudos
What programming frameworks and languages can be used with Databricks Feature Store
To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 partsPart 1) What languages can be utilized to write data frames as feature tables in the Feature...
- 7085 Views
- 7 replies
- 15 kudos
- 4262 Views
- 1 replies
- 2 kudos
Resolved! Unable to create feature table using databricks API .FeatureStoreClient()
I am following example steps from databricks documentation https://docs.databricks.com/_static/notebooks/machine-learning/feature-store-taxi-example.htmlI am using Feature Store client v0.3.6 and above.However on trying to create feature table with f...
- 4262 Views
- 1 replies
- 2 kudos
- 2 kudos
After much digging, observed i was using standard runtime. Once i switched to ML runtime of databricks, issue was resolved. To use Feature Store capability, ensure that you select a Databricks Runtime ML version from the Databricks Runtime Version dr...
- 2 kudos
- 4291 Views
- 2 replies
- 4 kudos
Feature Store - Feature Lookup Engine with join on partial key and Filter
Hello ,I am working with lookupEngine functions. However, we have some feature tables with granularity level most detailled of dataframe input.Please find an example :table A with unique keys on two features : numero_p, numero_s So while performing F...
- 4291 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @SERET Nathalie​ , I can check internally on the ask here. In the meantime please let us know if this helps: https://docs.databricks.com/machine-learning/feature-store/feature-tables.htmlhttps://docs.databricks.com/machine-learning/feature-store/i...
- 4 kudos
- 4630 Views
- 3 replies
- 2 kudos
Resolved! Problem creating FeatureStore
Hi,When trying to create the first table in the Feature Store i get a message: ''DataFrame' object has no attribute 'isEmpty'... but it is not. So I cannot use the function: feature_store.create_table()With this code you should be able to reproduce t...
- 4630 Views
- 3 replies
- 2 kudos
- 2 kudos
@Hubert Dudek​Sry about the 'df_train', I forgot to change it (the error I commented is real with the proper DF). Changing the DBR to 11.3 LTS solved the problem. Thanks!
- 2 kudos
- 10007 Views
- 5 replies
- 4 kudos
Unity Catalog - existing dbfs mounts and feature store
Hi All, We're currently considering turning on Unity Catalog but before we flick the switch I'm hoping I can get a bit more confidence of what will happen with our existing dbfs mounts and feature store. The bit that makes me nervous is the crede...
- 10007 Views
- 5 replies
- 4 kudos
- 4 kudos
@Ashley Betts​ can you please check below article, as far as i know we can use external mount points by configuring storage credentials in unity catalog . default method is managed tables, but we can point external tables also. 1. you can upgrade exi...
- 4 kudos
- 3091 Views
- 3 replies
- 0 kudos
Error in importing feature_store
from databricks import feature_storeI am trying to import feature_store but it is showing this error.ImportError: cannot import name 'feature_store' from 'databricks' (/databricks/python/lib/python3.8/site-packages/databricks/__init__.py)
- 3091 Views
- 3 replies
- 0 kudos
- 0 kudos
Is this issue resolved completely? We are facing the same problem. this might help.
- 0 kudos
- 2265 Views
- 1 replies
- 3 kudos
Feature Store - Feature Lookup with Filter
I am working with feature store to save the engineered features. However, for the specific case we have lots of feature table and lot of separate target variables on which we want to train separate models. Now for each of these model, we can leverage...
- 2265 Views
- 1 replies
- 3 kudos
- 3 kudos
Thanks for taking the time to let us know how to make Databricks even better! @Mayank Srivastava​ I love that you included a real-life example as well. I think I know the right PM at Databricks that will be interested in this input. Thanks again for...
- 3 kudos