cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Lakeflow Connect SharePoint - 403 Error

ChristianRRL
Honored Contributor

Hi, I'd like some help clarifying how lakeflow connect pipelines work (or should work). I went through the steps to (1) set up a connection, and (2) setup the ingestion, but I keep running into the following error:

Operation failed: "This request is not authorized to perform this operation.", 403

On checking the Ingestion Pipeline, I noticed that it's spinning up what I suspect are Job Clusters, but I'm not sure if the issue we're seeing here is due to either (A) the job cluster not having proper access due to some kind of network whitelisting issue for example, or (B) some issue with the access of the unity catalog/schema itself, or (C) something else entirely I may be missing.

Would appreciate some assistance here! Below are some related screenshots:

ChristianRRL_2-1784142904393.png

ChristianRRL_1-1784142354143.png

ChristianRRL_0-1784142213049.png

 

1 REPLY 1

henry_collins
New Contributor II

Check the permissions side first. A 403 usually points to an authorization issue rather than the cluster itself. Make sure the pipelineโ€™s service principal/user has the required Unity Catalog privileges on the target catalog, schema, and tables, and also verify the storage credentials/external locations if youโ€™re using them. If those look correct, then move on to checking network rules or workspace connectivity for the ingestion cluster. The pipeline cluster is managed by Lakeflow, so cluster-level access is usually less likely unless there are custom policies in place.

Helping users to solve Tech, Software, and Hardware Issues | Web Dev โ€ข SEO โ€ข Digital Solutions