cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Do you have information on the scalability and cost of using Databricks feature store?

Anonymous
Not applicable
1 ACCEPTED SOLUTION

Accepted Solutions

sajith_appukutt
Honored Contributor II

The feature store has both online / offline components. The offline feature store is used for feature discovery, model training, and batch inference and is backed by  Delta tables. You could read/write to offline store from Databricks clusters that support autoscaling . Cost would be a function of the amount of data processed and the complexities of the transformation.

For online stores, in AWS - we support publishing to

  • Aurora (MySQL-compatible)
  • RDS MySQL

There are different approaches to scale the online stores. Aurora for example supports autoscaling and with RDS, you could add read replicas to scale reads.

View solution in original post

1 REPLY 1

sajith_appukutt
Honored Contributor II

The feature store has both online / offline components. The offline feature store is used for feature discovery, model training, and batch inference and is backed by  Delta tables. You could read/write to offline store from Databricks clusters that support autoscaling . Cost would be a function of the amount of data processed and the complexities of the transformation.

For online stores, in AWS - we support publishing to

  • Aurora (MySQL-compatible)
  • RDS MySQL

There are different approaches to scale the online stores. Aurora for example supports autoscaling and with RDS, you could add read replicas to scale reads.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.