Delta sharing service Issue making requests to Unity System Access tables

[Paul92S]

Hi all,

We have been having an issue as of yesterday which I believe is related to queries against the system.access.table_linage in Unity Catalogs. This issue still persists today

We get the following error:

AnalysisException: [RequestId= ErrorClass=BAD_REQUEST] Delta Sharing Reconciliation Failed with: com.databricks.api.base.DatabricksServiceException: INTERNAL_ERROR: DS_INTERNAL_ERROR_FROM_DB_DS_SERVER: Failed request to sharing server Endpoint: https://data-sharing-service.data-sharing.svc.cluster.local:443/api/2.0/delta-sharing/metastores/...... Method: GET HTTP Code: 503 Status Line: 503

Please try again later. 

The query we are sending is from inside a Databricks notebook which has worked for months up to this point. I do understand that this particular table is in Public Preview

 

Also additional note when running a simple SELECT from this table using serverless SQL, it was taking a considerable amount of time. It appears to sometimes yield the results but most other times it does not.

Any advice or information on this particular issue would be greatly appreciated.

Cheers,

Paul

[Alberto_Umana]

Hi @Paul92S,

You mentioned it was working until yesterday, could you please share your cloud region or workspace?

We had an issue on AZ eastus2 so wondering if it is related. Is it working now?

[Paul92S]

Hi @Alberto_Umana,

We are running in UK South. 

Yes we are still currently seeing this as a problem unfortunately. 

[donalddvc]

We are seeing a similar issue since yesterday - also in UK South. We have raised it with our account team but no response so far.

[Alberto_Umana]

Hi @Paul92S,

Thanks for your details. I am seeing internally other reports since 2 days about the same failure. Our team is investigating and shall provide an update soon.

[rdadhichi]

We are having the same issue. Anyplace to track this ? (Northeurope/Uksouth )

[donalddvc]

We have been advised by our account team that this is due to 'a load balancing error of the Delta sharing server' and have raised a support ticket. In our case, the provider is in UK South and the recipient in North Europe. If I have an update on the ticket, I will post it here, but for the moment I suggest raising a high-priority ticket at Help Center - Databricks if this is a production issue for you.

[Alberto_Umana]

Team, I will provide an update as soon as we hear from our backend team working on this. 

[Alberto_Umana]

Hi All, looks like issue should have been mitigated, could you please confirm?

[Paul92S]

Hi @Alberto_Umana, yes I can confirm no longer an issue and looks to be resolved. Thanks for the updates on this!

[Alberto_Umana]

Thanks for your confirmation!

[donalddvc]

Resolved on our side too, so thank you very much everyone for your help.

[Alberto_Umana]

Thanks team, please let me know if you need any other help!