cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Dhanunjay
by New Contributor II
  • 1073 Views
  • 3 replies
  • 3 kudos

Is it possible to access online feature store (Cosmos DB) outside databricks?

We are building an machine learning application with feature store enabled. Once the model is built, we are trying to move the model artifacts and deploy it in azure ml as online endpoint. Does it possible to access the online store in azure ml endpo...

  • 1073 Views
  • 3 replies
  • 3 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 3 kudos

if you want databricks to use the feature store, which is in Cosmos DB, yes, it is possible https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/online-feature-storessuppose you want to consume a future store in Databrick...

  • 3 kudos
2 More Replies
mhansinger
by New Contributor II
  • 1117 Views
  • 4 replies
  • 2 kudos

Cannot write Feature Table because of invalid access token

From a notebook I created a new feature store via:%sql CREATE DATABASE IF NOT EXISTS feature_store_ebp;Within that feature store I fill my table with:feature_store_name = "feature_store_ebp.table_1" try: fs.write_table( name=feature_stor...

  • 1117 Views
  • 4 replies
  • 2 kudos
Latest Reply
Cami
Contributor III
  • 2 kudos

What kind of runtime machine (version) do you use to run this code?

  • 2 kudos
3 More Replies
VM
by Contributor
  • 8627 Views
  • 8 replies
  • 8 kudos

Resolved! Security exception while using Feature Store. How can I get this whitelisted?

I was following the Databricks Academy "New Capabilities Overview: Feature Store" module. However when I try to run the code in the example notebook I get a security exception as explained below. When I try to run the example notebook "01-Populate a ...

  • 8627 Views
  • 8 replies
  • 8 kudos
Latest Reply
OMG
New Contributor II
  • 8 kudos

Hi @Daniel Barrundia​ - please select "No isolation shared" Access mode, it should resolve this problem.

  • 8 kudos
7 More Replies
lawrence009
by Contributor
  • 682 Views
  • 2 replies
  • 3 kudos

Streaming Source for Feature Store (and outputMode)

To save computing resource and time, can I use streaming source in a batch mode (similar to Auto Loader) to update my feature store as my source table receives row update or is appended with new rows?

  • 682 Views
  • 2 replies
  • 3 kudos
Latest Reply
Meghala
Valued Contributor II
  • 3 kudos

yes you can schedule the job to process the data with auto loader

  • 3 kudos
1 More Replies
GabrieleMuciacc
by New Contributor III
  • 5099 Views
  • 13 replies
  • 13 kudos

Resolved! Delete feature tables through the Python API

The documentation explains how to delete feature tables through the UI. Is it possible to do the same using the Python FeatureStoreClient? I cannot find anything in the docs: https://docs.databricks.com/_static/documents/feature-store-python-api-refe...

  • 5099 Views
  • 13 replies
  • 13 kudos
Latest Reply
User16788316720
New Contributor III
  • 13 kudos

from databricks import feature_store fs = feature_store.FeatureStoreClient() fs.drop_table(FEATURE_TABLE_NAME)As of Databricks Runtime 10.5 for ML. Docs

  • 13 kudos
12 More Replies
isaac_gritz
by Valued Contributor II
  • 878 Views
  • 1 replies
  • 4 kudos

Databricks MLOps Best Practices

Where to find the best practices on MLOps on DatabricksWe recommend checking out the Big Book of MLOps for detailed guidance on MLOps best practices on Databricks including reference architectures.For a deep dive on the Databricks Feature store, we r...

  • 878 Views
  • 1 replies
  • 4 kudos
Latest Reply
sher
Valued Contributor II
  • 4 kudos

you can check here https://docs.databricks.com/machine-learning/mlops/mlops-workflow.html

  • 4 kudos
rjwswenson
by New Contributor II
  • 2475 Views
  • 7 replies
  • 15 kudos

What programming frameworks and languages can be used with Databricks Feature Store

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 partsPart 1) What languages can be utilized to write data frames as feature tables in the Feature...

  • 2475 Views
  • 7 replies
  • 15 kudos
Latest Reply
boyelana
Contributor III
  • 15 kudos

you can use any of these languages Python, SQL, Scala and R

  • 15 kudos
6 More Replies
ajeet1080
by New Contributor III
  • 1147 Views
  • 1 replies
  • 2 kudos

Resolved! Unable to create feature table using databricks API .FeatureStoreClient()

I am following example steps from databricks documentation https://docs.databricks.com/_static/notebooks/machine-learning/feature-store-taxi-example.htmlI am using Feature Store client v0.3.6 and above.However on trying to create feature table with f...

Screenshot 2022-11-29 at 2.10.43 PM pickup_features dataframe screenshot dropoff_features dataframe screenshot
  • 1147 Views
  • 1 replies
  • 2 kudos
Latest Reply
ajeet1080
New Contributor III
  • 2 kudos

After much digging, observed i was using standard runtime. Once i switched to ML runtime of databricks, issue was resolved. To use Feature Store capability, ensure that you select a Databricks Runtime ML version from the Databricks Runtime Version dr...

  • 2 kudos
NSRBX
by Contributor
  • 1352 Views
  • 2 replies
  • 4 kudos

Feature Store - Feature Lookup Engine with join on partial key and Filter

Hello ,I am working with lookupEngine functions. However, we have some feature tables with granularity level most detailled of dataframe input.Please find an example :table A with unique keys on two features : numero_p, numero_s So while performing F...

  • 1352 Views
  • 2 replies
  • 4 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 4 kudos

Hi @SERET Nathalie​ , I can check internally on the ask here. In the meantime please let us know if this helps: https://docs.databricks.com/machine-learning/feature-store/feature-tables.htmlhttps://docs.databricks.com/machine-learning/feature-store/i...

  • 4 kudos
1 More Replies
Cirsa
by New Contributor II
  • 2074 Views
  • 3 replies
  • 2 kudos

Resolved! Problem creating FeatureStore

Hi,When trying to create the first table in the Feature Store i get a message: ''DataFrame' object has no attribute 'isEmpty'... but it is not. So I cannot use the function: feature_store.create_table()With this code you should be able to reproduce t...

  • 2074 Views
  • 3 replies
  • 2 kudos
Latest Reply
Cirsa
New Contributor II
  • 2 kudos

@Hubert Dudek​Sry about the 'df_train', I forgot to change it (the error I commented is real with the proper DF). Changing the DBR to 11.3 LTS solved the problem. Thanks!

  • 2 kudos
2 More Replies
Ashley1
by Contributor
  • 4145 Views
  • 5 replies
  • 4 kudos

Unity Catalog - existing dbfs mounts and feature store

Hi All, We're currently considering turning on Unity Catalog but before we flick the switch I'm hoping I can get a bit more confidence of what will happen with our existing dbfs mounts and feature store. The bit that makes me nervous is the crede...

  • 4145 Views
  • 5 replies
  • 4 kudos
Latest Reply
karthik_p
Esteemed Contributor
  • 4 kudos

@Ashley Betts​ can you please check below article, as far as i know we can use external mount points by configuring storage credentials in unity catalog . default method is managed tables, but we can point external tables also. 1. you can upgrade exi...

  • 4 kudos
4 More Replies
sameer_gupta
by New Contributor
  • 1026 Views
  • 3 replies
  • 0 kudos

Error in importing feature_store

from databricks import feature_storeI am trying to import feature_store but it is showing this error.ImportError: cannot import name 'feature_store' from 'databricks' (/databricks/python/lib/python3.8/site-packages/databricks/__init__.py)

  • 1026 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Is this issue resolved completely? We are facing the same problem. this might help.

  • 0 kudos
2 More Replies
mayank347
by New Contributor II
  • 828 Views
  • 1 replies
  • 3 kudos

Feature Store - Feature Lookup with Filter

I am working with feature store to save the engineered features. However, for the specific case we have lots of feature table and lot of separate target variables on which we want to train separate models. Now for each of these model, we can leverage...

  • 828 Views
  • 1 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Thanks for taking the time to let us know how to make Databricks even better! @Mayank Srivastava​  I love that you included a real-life example as well. I think I know the right PM at Databricks that will be interested in this input. Thanks again for...

  • 3 kudos
Slalom_Tobias
by New Contributor III
  • 1585 Views
  • 2 replies
  • 3 kudos

Resolved! ML Practioner | ML 10 - Feature Store notebook | feature_store import error

the following code...from pyspark.sql.functions import monotonically_increasing_id, lit, expr, randimport uuidfrom databricks import feature_storefrom pyspark.sql.types import StringType, DoubleTypefrom databricks.feature_store import feature_table, ...

  • 1585 Views
  • 2 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hope that was an easy fix - @Tobias Cortese​ ! Thanks for marking the "best answer"!

  • 3 kudos
1 More Replies
vives
by New Contributor II
  • 1795 Views
  • 3 replies
  • 0 kudos

How to add signature to model logged through feature store?

It seems that the current method log_model from the FeatureStoreClient class lacks a way to pass in the model signature (as opposed as doing it through mlflow directly). Is there a workaround to append this information? Thanks!

  • 1795 Views
  • 3 replies
  • 0 kudos
Latest Reply
AmirLyall
New Contributor II
  • 0 kudos

Hello!You can log a model with a signature by passing a signature object as an argument with your log_model call. Please see here.Here's an example of this in action in a databricks notebook.Hope that helps!-Amir

  • 0 kudos
2 More Replies
Labels