Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-04-2025 11:07 PM
Hi,
I am getting this error after adding pip install and restart in _common.
EnvironmentError: Failed to set environment metadata. The Spark session may be unavailable, please try again or contact Databricks support.
File /databricks/python_shell/dbruntime/PipMagicOverrides.py:129, in PipMagicHandler.runCmd(self, magicCmd, line) 126 self.entry_point.getLogger()._logInfo( 127 f"{__name__}: Setting Setting spark.databricks.connect.environment to {serialized_env}." 128 ) --> 129 spark.conf.set("spark.databricks.connect.environment", serialized_env)
Could you please help?
Regards
Deepa
