Data bricks issue writing to Azure synapse
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 03:21 AM
Process is to pickup data from an external table in Azure Synapse and combine with other tables and write to another synapse tables. Data for external table is in Azure storage. It was fine for months ,all of sudden last week it errored out with error
Not able to validate external location because The remote server returned an error: (403) Forbidden. [ErrorCode = 105215] [SQLState = S0001]
Its at the end while writing the new records to synapse. Can someone please hep as all pipelines are falling over while writing to synapse.
Pipelines with dataflows are fine, its just the databricks one while writing to synapse .Its bit urgent. Not really sure what is causing this issue and where would be the fix
- Labels:
-
Azure
-
Databricks Issue
-
External Table
-
Writing
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 03:37 AM
Hi @Husnaara Nagri
Looks like an issue to access Azure Storage Account. Are you using Managed Service Identity to access Azure Storage ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 03:51 AM
Have checked this stackoverflow link,seems to be in place
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 03:39 AM
Also do check out this blog from this stack overflow question.
https://stackoverflow.com/questions/66747544/databricks-write-back-to-azure-synapse-error
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 03:51 AM
Thanks UmaD,it was working fine for months ,not sure what could trigger a change that would cause failure to write to synapse.Read is fine too.

