Error Listing Delta Log on GCS in Databricks

minhhung0507
Valued Contributor

I am encountering an issue while working with a Delta table in Databricks. The error message is as follows:

java.io.IOException: Error listing gs://cimb-prod-lakehouse/bronze-layer/dbd/customer_info_update_request_processing/_delta_log/

minhhung0507_0-1739502695009.png

This issue occurs when attempting to access the Delta table located at the specified GCS path. Could you please help me understand:

  1. What might be causing this error?
  2. How can I resolve it to successfully access the Delta table?

For context:

  • The Delta table is stored on Google Cloud Storage (GCS).
  • I have already configured the necessary credentials for GCS access in Databricks.

Any guidance or troubleshooting steps would be greatly appreciated.

Thank you!

Regards,
Hung Nguyen