<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: How to Retrieve the spark.statistics.createdAt When Statistics Were Last Updated in Databricks? in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/how-to-retrieve-the-spark-statistics-createdat-when-statistics/m-p/127465#M47977</link>
    <description>&lt;P&gt;Hello&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/166046"&gt;@Sainath368&lt;/a&gt;!&lt;/P&gt;
&lt;P&gt;sql.statistics.createdAt reflects the epoch time when statistics were created. Unfortunately, there's no direct command available to check when the statistics were last updated.&lt;/P&gt;
&lt;P&gt;As a workaround, you can manually set the current timestamp as a custom table property right after running the ANALYZE command.&lt;/P&gt;</description>
    <pubDate>Tue, 05 Aug 2025 13:52:15 GMT</pubDate>
    <dc:creator>Advika</dc:creator>
    <dc:date>2025-08-05T13:52:15Z</dc:date>
    <item>
      <title>How to Retrieve the spark.statistics.createdAt When Statistics Were Last Updated in Databricks?</title>
      <link>https://community.databricks.com/t5/data-engineering/how-to-retrieve-the-spark-statistics-createdat-when-statistics/m-p/127327#M47924</link>
      <description>&lt;P&gt;Hi everyone,&lt;/P&gt;&lt;P&gt;I regularly (once a week) run the analyze table compute statistics command on all my tables in Databricks to keep statistics up to date for query optimization.&lt;/P&gt;&lt;P&gt;In the Spark table UI catalog, I can see some statistics metadata like spark.statistics and spark.statistics.createdAt. However, when I query the table properties or use commands like describe table extended or check the table metadata programmatically, I can only retrieve statistics such as table size and row count — but not the&amp;nbsp;spark.statistics.createdAt value indicating when the statistics were last computed.&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Sainath368_0-1754309683688.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/18707i2337340F1AAD183B/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Sainath368_0-1754309683688.png" alt="Sainath368_0-1754309683688.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;I need to store this updated time in another table . Could anyone suggest a reliable method or the right command to retrieve the exact time when statistics were last updated or created for a table in Databricks/Spark?&lt;/P&gt;&lt;P&gt;Thanks in advance!&lt;BR /&gt;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;</description>
      <pubDate>Mon, 04 Aug 2025 12:20:43 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/how-to-retrieve-the-spark-statistics-createdat-when-statistics/m-p/127327#M47924</guid>
      <dc:creator>Sainath368</dc:creator>
      <dc:date>2025-08-04T12:20:43Z</dc:date>
    </item>
    <item>
      <title>Re: How to Retrieve the spark.statistics.createdAt When Statistics Were Last Updated in Databricks?</title>
      <link>https://community.databricks.com/t5/data-engineering/how-to-retrieve-the-spark-statistics-createdat-when-statistics/m-p/127465#M47977</link>
      <description>&lt;P&gt;Hello&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/166046"&gt;@Sainath368&lt;/a&gt;!&lt;/P&gt;
&lt;P&gt;sql.statistics.createdAt reflects the epoch time when statistics were created. Unfortunately, there's no direct command available to check when the statistics were last updated.&lt;/P&gt;
&lt;P&gt;As a workaround, you can manually set the current timestamp as a custom table property right after running the ANALYZE command.&lt;/P&gt;</description>
      <pubDate>Tue, 05 Aug 2025 13:52:15 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/how-to-retrieve-the-spark-statistics-createdat-when-statistics/m-p/127465#M47977</guid>
      <dc:creator>Advika</dc:creator>
      <dc:date>2025-08-05T13:52:15Z</dc:date>
    </item>
  </channel>
</rss>

