cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Setup learning environment failed: Configuration dbacademy.library.version is not available.

NSJ
New Contributor II

Using 1.3 Getting Started with the Databricks Platform Lab.  to self learning. When I run DE 2.1 to setup environment, got following error:
Configuration dbacademy.library.version is not available.
Following is the code in the common setup.

specified_version = f"v3.0.70"
key = "dbacademy.library.version"
version = spark.conf.get(key, specified_version)

Which version should I use?

3 REPLIES 3

Luipiu
New Contributor II

Hi

I resolved adding some instructions in the _common notebook, you can find inside the folder Includes

Put these at the beginning

%pip install git+https://github.com/databricks-academy/dbacademy@v3.0.70
%python dbutils.library.restartPython()
 
After this I obtain the error for the version of the cluster I was using, so I used the required DBR 11.3 to run the Classroom-Setup script

Deepa710
New Contributor III

Hi,

I am getting this error after adding pip install and restart in _common.

EnvironmentError: Failed to set environment metadata. The Spark session may be unavailable, please try again or contact Databricks support.
File /databricks/python_shell/dbruntime/PipMagicOverrides.py:129, in PipMagicHandler.runCmd(self, magicCmd, line) 126 self.entry_point.getLogger()._logInfo( 127 f"{__name__}: Setting Setting spark.databricks.connect.environment to {serialized_env}." 128 ) --> 129 spark.conf.set("spark.databricks.connect.environment", serialized_env)
 
Could you please help?
 
Regards
Deepa

 

Luipiu
New Contributor II

Perhaps you haven't the right permission. Are you able to create a SparkSession to check if you have this permission?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group