06-22-2021 02:17 AM
If I want to run TPC-DS test on databricks what are the steps involved, do we have already daya available on databricks file system or I have to download or create from somewhere.
06-22-2021 03:58 PM
For TPC -DS, checkout https://github.com/databricks/tpcds-kit . Databricks includes a variety of datasets mounted to the Databricks File System (DBFS) and this includes TPC-H
06-22-2021 08:54 PM
See the spark-sql-perf repo for details on how to run benchmark tests using TPC-DS - https://github.com/databricks/spark-sql-perf
11-20-2023 11:43 AM
I am new here 🙂 can you please explain one would run spark-sql-perf from a notebook?meaning how to reset a new spark application with the jars set.
