Can't access delta tables under SQL Warehouse cluster. Getting Error while using path .../_delta_log/000000000.checkpoint

[RafaelGomez61]

In our Databricks workspace, we have several delta tables available in the hive_metastore catalog. we are able to access and query the data via Data Science & Engineering persona clusters with no issues.

The cluster have the credential passthrough enabled. Therefore, the delta table source files reside on Azure Storage Account blob.

However, under the same workspace, when I try to access the same delta tables under the SQL persona via SQL Warehouse cluster using the same query, we get the following error:

Error message from server: org.apache.hive.service.cli.HiveSQLException: Error running query: com.databricks.backend.daemon.data.common.InvalidMountException: Error while using path /mnt/gold/***/delta/tableName/_delta_log/00000000000000000000.checkpoint for resolving path '/***/delta/tableName/_delta_log/00000000000000000000.checkpoint' within mount at '/mnt/gold'.  

Is the issue related to the credential passthrough that is enabled in the cluster? If so, how can we set Azure Storage account credentials onto the SQL Warehouse cluster?

Thanks

[karthik_p]

@Rafael Gomez​ credential pass through is legacy method, we can try managed identity or as you are not using unity catalog, can you try data access configuration as per below article and validate that should work https://learn.microsoft.com/en-us/azure/databricks/sql/admin/data-access-configuration

[Anonymous]

Hi @Rafael Gomez​ 

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you. 

Cheers!