Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-25-2022 02:21 PM
For worker node, you can set spark config in cluster setting: spark.executorEnv.PYTHONPATH
However you need to make sure you append your Workspace path at the end as worker node needs other system python path.
This seems to be a hack to me. I hope databricks can respond with a more solid solution.