cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

TPC-DI Benchmark in Databricks (ETL)

Stephanraj
New Contributor III

Similar to TPC-DS and TPC-H benchmark, is it possible to execute TPC-DI benchmark in Databricks. What is the feasibility to execute TPC-DI benchmark, please let me know if there is any existing ETL Tool available in Databricks for TPC-DI. 

For reference: https://www.tpc.org/tpc_documents_current_versions/pdf/tpc-di_v1.1.0.pdf

2 REPLIES 2

franco_patano
New Contributor III
New Contributor III

Actually, we are working on it. We talked about it last summit.

https://www.youtube.com/watch?v=zMbeP6Zc_Xk

Franco Patano
Stragetic Data and AI Advisor

Shannon_Barrow
New Contributor II
New Contributor II

Hello, we recently made public a repo that makes it easy to run the TPC-DI benchmark end-to-end - in a variety of ways. The repo can be found here. Feel free to let me know if you have any issues running it!

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!