anagilla
Databricks Employee
Databricks Employee

The managed SharePoint connector uses serverless compute; it can't be switched to classic Job Compute.

The Job you see is the orchestration layer: Lakeflow Connect creates it for the schedule and runs the ingestion pipeline as a task, while the pipeline itself stays on managed serverless compute.

  1. Make sure serverless compute and the SharePoint Beta preview are enabled for the workspace, as required by the managed connector setup.

  2. If managed serverless is acceptable, keep the current pipeline; there is no cluster configuration to change.

  3. If you need to choose the compute, use the standard SharePoint connector with SQL, PySpark, or Auto Loader on DBR 17.3 LTS or later.

View solution in original post