cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

TPC-DI Benchmark in Databricks (ETL)

Stephanraj
New Contributor III

Similar to TPC-DS and TPC-H benchmark, is it possible to execute TPC-DI benchmark in Databricks. What is the feasibility to execute TPC-DI benchmark, please let me know if there is any existing ETL Tool available in Databricks for TPC-DI. 

For reference: https://www.tpc.org/tpc_documents_current_versions/pdf/tpc-di_v1.1.0.pdf

2 REPLIES 2

franco_patano
New Contributor III
New Contributor III

Actually, we are working on it. We talked about it last summit.

https://www.youtube.com/watch?v=zMbeP6Zc_Xk

Franco Patano
Stragetic Data and AI Advisor

Shannon_Barrow
New Contributor II
New Contributor II

Hello, we recently made public a repo that makes it easy to run the TPC-DI benchmark end-to-end - in a variety of ways. The repo can be found here. Feel free to let me know if you have any issues running it!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.