cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta sharing service Issue making requests to Unity System Access tables

Paul92S
New Contributor III

Hi all,

 

We have been having an issue as of yesterday which I believe is related to queries against the system.access.table_linage in Unity Catalogs. This issue still persists today

We get the following error:

AnalysisException: [RequestId= ErrorClass=BAD_REQUEST] Delta Sharing Reconciliation Failed with: com.databricks.api.base.DatabricksServiceException: INTERNAL_ERROR: DS_INTERNAL_ERROR_FROM_DB_DS_SERVER: Failed request to sharing server Endpoint: https://data-sharing-service.data-sharing.svc.cluster.local:443/api/2.0/delta-sharing/metastores/...... Method: GET HTTP Code: 503 Status Line: 503

Please try again later. 

The query we are sending is from inside a Databricks notebook which has worked for months up to this point. I do understand that this particular table is in Public Preview

table lineage.png 

Also additional note when running a simple SELECT from this table using serverless SQL, it was taking a considerable amount of time. It appears to sometimes yield the results but most other times it does not.

delta sharing issue.png

Any advice or information on this particular issue would be greatly appreciated.

Cheers,

Paul

8 REPLIES 8

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @Paul92S,

You mentioned it was working until yesterday, could you please share your cloud region or workspace?

We had an issue on AZ eastus2 so wondering if it is related. Is it working now?

Hi @Alberto_Umana,

We are running in UK South. 

Yes we are still currently seeing this as a problem unfortunately. 

We are seeing a similar issue since yesterday - also in UK South. We have raised it with our account team but no response so far.

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @Paul92S,

Thanks for your details. I am seeing internally other reports since 2 days about the same failure. Our team is investigating and shall provide an update soon.

rdadhichi
Visitor

We are having the same issue. Anyplace to track this ? (Northeurope/Uksouth )

We have been advised by our account team that this is due to 'a load balancing error of the Delta sharing server' and have raised a support ticket. In our case, the provider is in UK South and the recipient in North Europe. If I have an update on the ticket, I will post it here, but for the moment I suggest raising a high-priority ticket at Help Center - Databricks if this is a production issue for you.

Alberto_Umana
Databricks Employee
Databricks Employee

Team, I will provide an update as soon as we hear from our backend team working on this. 

Alberto_Umana
Databricks Employee
Databricks Employee

Hi All, looks like issue should have been mitigated, could you please confirm?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group