topic How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? in Data Engineering https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19436#M13021 <P>I tried use the Spark Cluster UI. But the queries are truncated.</P> Fri, 27 May 2022 09:08:07 GMT jwilliam 2022-05-27T09:08:07Z How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19436#M13021 <P>I tried use the Spark Cluster UI. But the queries are truncated.</P> Fri, 27 May 2022 09:08:07 GMT https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19436#M13021 jwilliam 2022-05-27T09:08:07Z Re: How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19437#M13022 <P>The traditional cluster doesn't save a list of SQL queries. It has a SQL UI, but it shows a dag of what happened rather than the full query. </P> Fri, 27 May 2022 14:47:16 GMT https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19437#M13022 Anonymous 2022-05-27T14:47:16Z Re: How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19438#M13023 <P>Hi @Joseph Kambourakis​&nbsp;, does Databricks have any plans to support this in the future?</P> Mon, 30 May 2022 03:50:13 GMT https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19438#M13023 jwilliam 2022-05-30T03:50:13Z Re: How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19439#M13024 <P>In Apache Spark prior to 2.1, once a SQL query was run, there was no way to re-run it; all history was lost. Spark SQL introduced the "replay" functionality in Spark 2.1.0, enabling users to re-run any query they have already run. You can run a query once, save the query plan, and then later open the saved plan and run the query again<A href="https://www.walkermaster.com/" alt="https://www.walkermaster.com/" target="_blank">.</A> This type of history is stored in a table named sql query plan in the database. This can be seen by using the SHOW TABLES statement in the Spark SQL console.</P> Tue, 31 May 2022 10:09:44 GMT https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19439#M13024 walkermaster12 2022-05-31T10:09:44Z Re: How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)? https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19440#M13025 <P>@John William​&nbsp;it's definitely something we'd like to do.</P> Fri, 03 Jun 2022 20:18:38 GMT https://community.databricks.com/t5/data-engineering/how-to-view-the-sql-query-history-of-traditional-databricks/m-p/19440#M13025 BilalAslamDbrx 2022-06-03T20:18:38Z