cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

thomasm
by New Contributor II
  • 1918 Views
  • 3 replies
  • 1 kudos

Resolved! Online Feature Store MLflow serving problem

When I try to serve a model stored with FeatureStoreClient().log_model using the feature-store-online-example-cosmosdb tutorial Notebook, I get errors suggesting that the primary key schema is not configured properly. However, if I look in the Featur...

  • 1918 Views
  • 3 replies
  • 1 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 1 kudos

Hello @Thomas Michielsen​ , this error seems to occur when you may have created the table yourself. You must use publish_table() to create the table in the online store. Do not manually create a database or container inside Cosmos DB. publish_table()...

  • 1 kudos
2 More Replies
rjwswenson
by New Contributor II
  • 2661 Views
  • 7 replies
  • 15 kudos

What programming frameworks and languages can be used with Databricks Feature Store

To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 partsPart 1) What languages can be utilized to write data frames as feature tables in the Feature...

  • 2661 Views
  • 7 replies
  • 15 kudos
Latest Reply
boyelana
Contributor III
  • 15 kudos

you can use any of these languages Python, SQL, Scala and R

  • 15 kudos
6 More Replies
ajeet1080
by New Contributor III
  • 1226 Views
  • 1 replies
  • 2 kudos

Resolved! Unable to create feature table using databricks API .FeatureStoreClient()

I am following example steps from databricks documentation https://docs.databricks.com/_static/notebooks/machine-learning/feature-store-taxi-example.htmlI am using Feature Store client v0.3.6 and above.However on trying to create feature table with f...

Screenshot 2022-11-29 at 2.10.43 PM pickup_features dataframe screenshot dropoff_features dataframe screenshot
  • 1226 Views
  • 1 replies
  • 2 kudos
Latest Reply
ajeet1080
New Contributor III
  • 2 kudos

After much digging, observed i was using standard runtime. Once i switched to ML runtime of databricks, issue was resolved. To use Feature Store capability, ensure that you select a Databricks Runtime ML version from the Databricks Runtime Version dr...

  • 2 kudos
deep_thought
by New Contributor III
  • 1098 Views
  • 3 replies
  • 0 kudos

Resolved! How to drop single feature from feature store table

I have a feature store table and I would like to change one of the features from IntegerType to FloatType, I can't merge this change as it violates the schema. Is it possible to drop a single feature from the table and add the revised feature?Current...

  • 1098 Views
  • 3 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi there @_ _​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!

  • 0 kudos
2 More Replies
Ashley1
by Contributor
  • 3053 Views
  • 5 replies
  • 5 kudos

Feature table: merge very slow

Hi All, We're just started to look at the feature store capabilities of Databricks. Our first attempt to create a feature table has resulted in very slow write. To avoid the time incurred by the feature functions I generated a dataframe with same...

Historical Spark UI for cluster 0622-013318-zoqth84b, driver 332737051535251367 - Details for Query 352
  • 3053 Views
  • 5 replies
  • 5 kudos
Latest Reply
Vidula
Honored Contributor
  • 5 kudos

Hi @Ashley Betts​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 5 kudos
4 More Replies
thib
by New Contributor III
  • 1119 Views
  • 3 replies
  • 4 kudos

Resolved! Feature store : Can create_training_set() be implemented to execute an inner join?

For timeseries feature tables, an inner join is made at the creation of the feature table. For the other type of feature tables, a left join is made, so NaN values can show up in the training set. Can the inner join in create_training_set() method be...

  • 1119 Views
  • 3 replies
  • 4 kudos
Latest Reply
thib
New Contributor III
  • 4 kudos

Thank you Hubert, that's a good alternative, I just thought I'd stick to the api as much as possible, but this solves it.

  • 4 kudos
2 More Replies
Edmondo
by New Contributor III
  • 1194 Views
  • 3 replies
  • 0 kudos

Resolved! MlFlow and Feature Store: mlflow.spark.autolog, using feature store on Databricks, FeatureStoreClient.log_model()?

As I am moving my first steps within the Databricks Machine Learning Workspace, I am getting confused by some features that by "documentation" seem to overlap. Does autolog for spark on mlflow provide different tracking than using a training set crea...

  • 1194 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Edmondo Porcu​ , FeatureStoreClient.log_model() logs an MLflow model packaged with feature lookup information.Sourcemlflow.spark.autolog(disable=False, silent=False) enables (or disables) and configures logging of Spark data source paths, versio...

  • 0 kudos
2 More Replies
User16789201666
by Contributor II
  • 1018 Views
  • 1 replies
  • 0 kudos

When would you use the Feature Store?

For example would you use a feature store on your raw data or what's is the granularity of the features in the store?

  • 1018 Views
  • 1 replies
  • 0 kudos
Latest Reply
Joseph_B
New Contributor III
  • 0 kudos

I'll try to answer the broad question first, followed by the specific ones.When would you use the Feature Store?A Feature Store is primarily used to solve 2 challenges.(1) Discoverability and governance of featuresChallenge: In a large team or organi...

  • 0 kudos
Labels