https://community.databricks.com/t5/data-engineering/audit-vertica-tables-in-spark/m-p/32658#M23803 <P>I am trying to use Audit from Vertica in spark and getting correct table size from it, but the minimum size Audit function can find is bytes, but we are getting data in bits even smaller than bytes. </P><P></P><P></P><P>val size = f"select audit('table_name');"</P><P></P> Tue, 21 Dec 2021 05:13:49 GMT sarvesh 2021-12-21T05:13:49Z https://community.databricks.com/t5/data-engineering/audit-vertica-tables-in-spark/m-p/32658#M23803 <P>I am trying to use Audit from Vertica in spark and getting correct table size from it, but the minimum size Audit function can find is bytes, but we are getting data in bits even smaller than bytes. </P><P></P><P></P><P>val size = f"select audit('table_name');"</P><P></P> Tue, 21 Dec 2021 05:13:49 GMT https://community.databricks.com/t5/data-engineering/audit-vertica-tables-in-spark/m-p/32658#M23803 sarvesh 2021-12-21T05:13:49Z https://community.databricks.com/t5/data-engineering/audit-vertica-tables-in-spark/m-p/32659#M23804 <P>Rather everything will be in bytes. Spak sql have built in methods to get table size but also in bytes:</P><P></P><P>spark.sql("ANALYZE TABLE df COMPUTE STATISTICS NOSCAN")</P><P>spark.sql("DESCRIBE EXTENDED df ").filter(col("col_name") === "Statistics").show(false)</P><P></P> Tue, 21 Dec 2021 12:34:47 GMT https://community.databricks.com/t5/data-engineering/audit-vertica-tables-in-spark/m-p/32659#M23804 Hubert-Dudek 2021-12-21T12:34:47Z