cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Online Feature Table : Storage

AnkurMittal008
New Contributor III

Databricks Online Feature Table is in public preview , And we have some questions on this 

1) What storage is being used for Online Feature table's Data. Our offline feature table is stored in Unity Catalog managed S3 bucket (Customer AWS ). Does online feature table use databrick's internal storage or customer's Cloud ?

2) https://www.databricks.com/product/pricing/online-tables How we can get the storage cost information. For capacity units we can use billing_origin_product = ONLINE_TABLES.

3) Are there explicit charges for data refresh from offline source table to online table "Snapshot or Triggered sync mode (data transfer)"  ?

1 ACCEPTED SOLUTION

Accepted Solutions

Walter_C
Databricks Employee
Databricks Employee

1) Storage for Online Feature Table's Data:

Online Feature Tables use Databricks' internal storage. They are fully serverless tables that auto-scale throughput capacity with the request load and provide low latency and high throughput access to data of any scale. This means that the data for Online Feature Tables is not stored in the customer's cloud storage but in Databricks' managed infrastructure.

2) Storage Cost Information: For storage cost information, you can refer to the URL provided: Online Tables Pricing. Billing for Online Tables Capacity Units began on or after October 1, 2024, and billing for Online Tables Storage began on or after November 1, 2024. You can use the billing_origin_product = ONLINE_TABLES to get information on capacity units.

3) There is no explicit mention on costs for ofline source table to online operations but let me confirm on this.

View solution in original post

2 REPLIES 2

Walter_C
Databricks Employee
Databricks Employee

1) Storage for Online Feature Table's Data:

Online Feature Tables use Databricks' internal storage. They are fully serverless tables that auto-scale throughput capacity with the request load and provide low latency and high throughput access to data of any scale. This means that the data for Online Feature Tables is not stored in the customer's cloud storage but in Databricks' managed infrastructure.

2) Storage Cost Information: For storage cost information, you can refer to the URL provided: Online Tables Pricing. Billing for Online Tables Capacity Units began on or after October 1, 2024, and billing for Online Tables Storage began on or after November 1, 2024. You can use the billing_origin_product = ONLINE_TABLES to get information on capacity units.

3) There is no explicit mention on costs for ofline source table to online operations but let me confirm on this.

AnkurMittal008
New Contributor III

Thanks a lot @Walter_C ..

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group