AWS S3 External Location Size in Unity Catalog
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2023 01:22 PM
Hi,
I am trying to get the raw size (total size) of delta table. I could get delta table size from DeltaTable api but that gives only latest version size. I need to find the actual S3 size the tables takes on S3.
Is there any way, to find the S3 size on Unity catalog enabled workspace. I don't want to assign instance profile solely for this purpose.
Appreciate any inputs / guidance.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-19-2023 04:37 AM
Hi Kaniz,
Thank you for your suggestions. As per my understanding, the "snapshot.sizeInBytes" gives only current snapshot size. But I am looking for total size (all versions) of the table on S3.
