TPC-DI Benchmark in Databricks (ETL)

Stephanraj
Databricks Partner

‎12-06-2022 03:06 AM

Similar to TPC-DS and TPC-H benchmark, is it possible to execute TPC-DI benchmark in Databricks. What is the feasibility to execute TPC-DI benchmark, please let me know if there is any existing ETL Tool available in Databricks for TPC-DI. 

For reference: https://www.tpc.org/tpc_documents_current_versions/pdf/tpc-di_v1.1.0.pdf

0 Kudos

franco_patano
Databricks Employee
Databricks Employee

‎03-21-2023 07:21 PM

Actually, we are working on it. We talked about it last summit.

https://www.youtube.com/watch?v=zMbeP6Zc_Xk

Franco Patano
Stragetic Data and AI Advisor
0 Kudos

Shannon_Barrow
Databricks Employee
Databricks Employee

‎04-12-2023 05:49 PM

Hello, we recently made public a repo that makes it easy to run the TPC-DI benchmark end-to-end - in a variety of ways. The repo can be found here. Feel free to let me know if you have any issues running it!

0 Kudos