โ05-11-2023 07:08 AM
I want to check the size of the delta table by partition.
As you can see, only the size of the table can be checked, but not by partition.
โ05-13-2023 08:57 AM
@jin parkโ :
You can use the Databricks Delta Lake SHOW TABLE EXTENDED command to get the size of each partition of the table. Here's an example:
%sql
SHOW TABLE EXTENDED LIKE '<table_name>'
PARTITION (<partition_column> = '<partition_value>')
SELECT sizeInBytes
Replace <table_name> with the name of your Delta table, <partition_column> with the name of your partition column, and <partition_value> with the specific partition value you want to check the size for. If you want to check the size for all partitions, omit the PARTITION clause.
You can also use the DESCRIBE DETAIL command to get similar information:
%sql
DESCRIBE DETAIL <table_name>
This will show you detailed information about the table, including the size of each partition.
โ05-14-2023 12:57 AM
There is no 'sizeInbytes' item.
โ06-09-2023 12:23 AM
@jin parkโ : Please try this
DESCRIBE DETAIL your_table_name PARTITION (partition_column = 'partition_value')
Replace 'your_table_name' with the actual name of your table and specify the appropriate partition_column and partition_value you want to check.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.