- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-22-2026 12:18 PM
the sys.path approach won’t fix this for Lakeflow Connect pipelines. During a dry run, Databricks imports databricks.labs.community_connector before your ingest notebook runs, using only the pipeline’s Environment dependencies.
Fix: Pipeline Settings → Pipeline environment → Edit environment → add:
Use the repo root that contains pyproject.toml and src/ (not src/ itself). Then dry run again.
Also confirm the full package exists under src/databricks/labs/community_connector/ — if you only copied your connector source + ingest.ipynb without the framework files, the import will still fail.
%pip install in the ingest notebook isn’t supported for pipelines; dependencies must be declared in Environment settings. See: https://docs.databricks.com/aws/en/ldp/developer/external-dependencies