echozhuoocl
New Contributor II
In response to szymon_dybczak

‎08-26-2025 12:51 AM

hi, please be patient to see my issue, thank you very much:

25/08/26 13:46:21 WARN RemoteSnapshot: Getting table size from a full file scan for table: on-prem-delta-sharing.dmsa_in_nrt.shp_rating_snapshot

25/08/26 14:35:12 INFO CachedTableManager: Updating pre signed urls for s3a://dmsa/tmp/the_credential_of_deltasharing/on_prem_deltasharing.share#on-prem-delta-sharing.dmsa_in_nrt.shp_rating_snapshot (expiration time: Tue Aug 26 14:49:22 CST 2025)

25/08/26 14:49:25 INFO CachedTableManager: Removing table s3a://dmsa/tmp/the_credential_of_deltasharing/on_prem_deltasharing.share#on-prem-delta-sharing.dmsa_in_nrt.shp_rating_snapshot from the pre signed url cache as it was not accessed after 3600000 ms

 

25/08/26 15:04:19 ERROR Inbox: Ignoring error
java.lang.IllegalStateException: table s3a://dmsa/tmp/the_credential_of_deltasharing/on_prem_deltasharing.share#on-prem-delta-sharing.dmsa_in_nrt.shp_rating_snapshot was removed
at org.apache.spark.delta.sharing.CachedTableManager.getPreSignedUrl(PreSignedUrlCache.scala:136) ~[dmsa_shp-0.0.1.jar:?]

 

 

0 Kudos