cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

thomasm
by New Contributor II
  • 3200 Views
  • 3 replies
  • 1 kudos

Resolved! Online Feature Store MLflow serving problem

When I try to serve a model stored with FeatureStoreClient().log_model using the feature-store-online-example-cosmosdb tutorial Notebook, I get errors suggesting that the primary key schema is not configured properly. However, if I look in the Featur...

  • 3200 Views
  • 3 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

Hello @Thomas Michielsen​ , this error seems to occur when you may have created the table yourself. You must use publish_table() to create the table in the online store. Do not manually create a database or container inside Cosmos DB. publish_table()...

  • 1 kudos
2 More Replies
rjwswenson
by New Contributor II
  • 4377 Views
  • 7 replies
  • 15 kudos

What programming frameworks and languages can be used with Databricks Feature Store

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 partsPart 1) What languages can be utilized to write data frames as feature tables in the Feature...

  • 4377 Views
  • 7 replies
  • 15 kudos
Latest Reply
boyelana
Contributor III
  • 15 kudos

you can use any of these languages Python, SQL, Scala and R

  • 15 kudos
6 More Replies
ajeet1080
by New Contributor III
  • 2250 Views
  • 1 replies
  • 2 kudos

Resolved! Unable to create feature table using databricks API .FeatureStoreClient()

I am following example steps from databricks documentation https://docs.databricks.com/_static/notebooks/machine-learning/feature-store-taxi-example.htmlI am using Feature Store client v0.3.6 and above.However on trying to create feature table with f...

Screenshot 2022-11-29 at 2.10.43 PM pickup_features dataframe screenshot dropoff_features dataframe screenshot
  • 2250 Views
  • 1 replies
  • 2 kudos
Latest Reply
ajeet1080
New Contributor III
  • 2 kudos

After much digging, observed i was using standard runtime. Once i switched to ML runtime of databricks, issue was resolved. To use Feature Store capability, ensure that you select a Databricks Runtime ML version from the Databricks Runtime Version dr...

  • 2 kudos
deep_thought
by Contributor
  • 1996 Views
  • 3 replies
  • 3 kudos

Resolved! How to drop single feature from feature store table

I have a feature store table and I would like to change one of the features from IntegerType to FloatType, I can't merge this change as it violates the schema. Is it possible to drop a single feature from the table and add the revised feature?Current...

  • 1996 Views
  • 3 replies
  • 3 kudos
Latest Reply
Vidula
Honored Contributor
  • 3 kudos

Hi there @_ _​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!

  • 3 kudos
2 More Replies
Ashley1
by Contributor
  • 4673 Views
  • 5 replies
  • 5 kudos

Feature table: merge very slow

Hi All, We're just started to look at the feature store capabilities of Databricks. Our first attempt to create a feature table has resulted in very slow write. To avoid the time incurred by the feature functions I generated a dataframe with same...

Historical Spark UI for cluster 0622-013318-zoqth84b, driver 332737051535251367 - Details for Query 352
  • 4673 Views
  • 5 replies
  • 5 kudos
Latest Reply
Vidula
Honored Contributor
  • 5 kudos

Hi @Ashley Betts​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 5 kudos
4 More Replies
thib
by New Contributor III
  • 1835 Views
  • 3 replies
  • 4 kudos

Resolved! Feature store : Can create_training_set() be implemented to execute an inner join?

For timeseries feature tables, an inner join is made at the creation of the feature table. For the other type of feature tables, a left join is made, so NaN values can show up in the training set. Can the inner join in create_training_set() method be...

  • 1835 Views
  • 3 replies
  • 4 kudos
Latest Reply
thib
New Contributor III
  • 4 kudos

Thank you Hubert, that's a good alternative, I just thought I'd stick to the api as much as possible, but this solves it.

  • 4 kudos
2 More Replies
Edmondo
by New Contributor III
  • 1818 Views
  • 0 replies
  • 0 kudos

MlFlow and Feature Store: mlflow.spark.autolog, using feature store on Databricks, FeatureStoreClient.log_model()?

As I am moving my first steps within the Databricks Machine Learning Workspace, I am getting confused by some features that by "documentation" seem to overlap. Does autolog for spark on mlflow provide different tracking than using a training set crea...

  • 1818 Views
  • 0 replies
  • 0 kudos
User16789201666
by Databricks Employee
  • 1349 Views
  • 1 replies
  • 0 kudos

When would you use the Feature Store?

For example would you use a feature store on your raw data or what's is the granularity of the features in the store?

  • 1349 Views
  • 1 replies
  • 0 kudos
Latest Reply
Joseph_B
Databricks Employee
  • 0 kudos

I'll try to answer the broad question first, followed by the specific ones.When would you use the Feature Store?A Feature Store is primarily used to solve 2 challenges.(1) Discoverability and governance of featuresChallenge: In a large team or organi...

  • 0 kudos
User16789201666
by Databricks Employee
  • 3154 Views
  • 1 replies
  • 0 kudos

When should we use offline store vs online store for Feature Store?

Looking at the docs we see both options, can we use both e.g.?

  • 3154 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16789201666
Databricks Employee
  • 0 kudos

Online store is for real time inferencing, in most case you will use the offline store.

  • 0 kudos
Labels