11-28-2022 03:21 AM
Process is to pickup data from an external table in Azure Synapse and combine with other tables and write to another synapse tables. Data for external table is in Azure storage. It was fine for months ,all of sudden last week it errored out with error
Not able to validate external location because The remote server returned an error: (403) Forbidden. [ErrorCode = 105215] [SQLState = S0001]
Its at the end while writing the new records to synapse. Can someone please hep as all pipelines are falling over while writing to synapse.
Pipelines with dataflows are fine, its just the databricks one while writing to synapse .Its bit urgent. Not really sure what is causing this issue and where would be the fix
11-28-2022 03:37 AM
Hi @Husnaara Nagri
Looks like an issue to access Azure Storage Account. Are you using Managed Service Identity to access Azure Storage ?
11-28-2022 03:51 AM
Have checked this stackoverflow link,seems to be in place
11-28-2022 03:39 AM
Also do check out this blog from this stack overflow question.
https://stackoverflow.com/questions/66747544/databricks-write-back-to-azure-synapse-error
11-28-2022 03:51 AM
Thanks UmaD,it was working fine for months ,not sure what could trigger a change that would cause failure to write to synapse.Read is fine too.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group