cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Setup learning environment failed: Configuration dbacademy.library.version is not available.

NSJ
New Contributor II

Using 1.3 Getting Started with the Databricks Platform Lab.  to self learning. When I run DE 2.1 to setup environment, got following error:
Configuration dbacademy.library.version is not available.
Following is the code in the common setup.

specified_version = f"v3.0.70"
key = "dbacademy.library.version"
version = spark.conf.get(key, specified_version)

Which version should I use?

3 REPLIES 3

Luipiu
New Contributor III

Hi

I resolved adding some instructions in the _common notebook, you can find inside the folder Includes

Put these at the beginning

%pip install git+https://github.com/databricks-academy/dbacademy@v3.0.70
%python dbutils.library.restartPython()
 
After this I obtain the error for the version of the cluster I was using, so I used the required DBR 11.3 to run the Classroom-Setup script

Deepa710
New Contributor III

Hi,

I am getting this error after adding pip install and restart in _common.

EnvironmentError: Failed to set environment metadata. The Spark session may be unavailable, please try again or contact Databricks support.
File /databricks/python_shell/dbruntime/PipMagicOverrides.py:129, in PipMagicHandler.runCmd(self, magicCmd, line) 126 self.entry_point.getLogger()._logInfo( 127 f"{__name__}: Setting Setting spark.databricks.connect.environment to {serialized_env}." 128 ) --> 129 spark.conf.set("spark.databricks.connect.environment", serialized_env)
 
Could you please help?
 
Regards
Deepa

 

Luipiu
New Contributor III

Perhaps you haven't the right permission. Are you able to create a SparkSession to check if you have this permission?

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now