topic Re: Delta sharing service Issue making requests to Unity System Access tables in Data Engineering

Delta sharing service Issue making requests to Unity System Access tables

Paul92S — Fri, 10 Jan 2025 09:58:27 GMT

Hi all,

We have been having an issue as of yesterday which I believe is related to queries against the system.access.table_linage in Unity Catalogs. This issue still persists today

We get the following error:

AnalysisException: [RequestId= ErrorClass=BAD_REQUEST] Delta Sharing Reconciliation Failed with: com.databricks.api.base.DatabricksServiceException: INTERNAL_ERROR: DS_INTERNAL_ERROR_FROM_DB_DS_SERVER: Failed request to sharing server Endpoint: https://data-sharing-service.data-sharing.svc.cluster.local:443/api/2.0/delta-sharing/metastores/...../shares/system_schemas_access_share/schemas/access/tables/table_lineage/metadata Method: GET HTTP Code: 503 Status Line: 503

Please try again later.

The query we are sending is from inside a Databricks notebook which has worked for months up to this point. I do understand that this particular table is in Public Preview

Also additional note when running a simple SELECT from this table using serverless SQL, it was taking a considerable amount of time. It appears to sometimes yield the results but most other times it does not.

Any advice or information on this particular issue would be greatly appreciated.

Cheers,

Paul

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Fri, 10 Jan 2025 12:34:47 GMT

Hi @Paul92S,

You mentioned it was working until yesterday, could you please share your cloud region or workspace?

We had an issue on AZ eastus2 so wondering if it is related. Is it working now?

Re: Delta sharing service Issue making requests to Unity System Access tables

Paul92S — Fri, 10 Jan 2025 12:45:14 GMT

Hi @Alberto_Umana,

We are running in UK South.

Yes we are still currently seeing this as a problem unfortunately.

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Fri, 10 Jan 2025 13:04:55 GMT

Hi @Paul92S,

Thanks for your details. I am seeing internally other reports since 2 days about the same failure. Our team is investigating and shall provide an update soon.

Re: Delta sharing service Issue making requests to Unity System Access tables

donalddvc — Fri, 10 Jan 2025 13:05:44 GMT

We are seeing a similar issue since yesterday - also in UK South. We have raised it with our account team but no response so far.

Re: Delta sharing service Issue making requests to Unity System Access tables

rdadhichi — Fri, 10 Jan 2025 14:51:57 GMT

We are having the same issue. Anyplace to track this ? (Northeurope/Uksouth )

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Fri, 10 Jan 2025 15:20:52 GMT

Team, I will provide an update as soon as we hear from our backend team working on this.

Re: Delta sharing service Issue making requests to Unity System Access tables

donalddvc — Fri, 10 Jan 2025 15:22:53 GMT

We have been advised by our account team that this is due to 'a load balancing error of the Delta sharing server' and have raised a support ticket. In our case, the provider is in UK South and the recipient in North Europe. If I have an update on the ticket, I will post it here, but for the moment I suggest raising a high-priority ticket at Help Center - Databricks if this is a production issue for you.

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Fri, 10 Jan 2025 17:55:15 GMT

Hi All, looks like issue should have been mitigated, could you please confirm?

Re: Delta sharing service Issue making requests to Unity System Access tables

Paul92S — Mon, 13 Jan 2025 11:19:10 GMT

Hi @Alberto_Umana, yes I can confirm no longer an issue and looks to be resolved. Thanks for the updates on this!

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Mon, 13 Jan 2025 12:19:48 GMT

Thanks for your confirmation!

Re: Delta sharing service Issue making requests to Unity System Access tables

donalddvc — Mon, 13 Jan 2025 12:22:03 GMT

Resolved on our side too, so thank you very much everyone for your help.

Re: Delta sharing service Issue making requests to Unity System Access tables

Alberto_Umana — Mon, 13 Jan 2025 12:52:47 GMT

Thanks team, please let me know if you need any other help!