iFoxz17
Databricks Partner

@ManojkMohan as mentioned in the first post I already used dict(spark.conf.getAll()).get(key, default) where possible.
However the problem stands when importing modules, like:

- from dbacademy import dbgems

- from dbacademy.dbhelper import DBAcademyHelper, Paths, CourseConfig, LessonConfig
- from dbacademy.dbhelper.validations.validation_helper_class import ValidationHelper
 
I also tried to use the last release (Release v5.0.11 · databricks-academy/dbacademy), without success.
Finally, the idea of setting manually the missing keys with spark.conf.set is failing too, raising the same exception for the missing key:
--------------------------------------------------------------
spark.conf.set("missing_key", "default")
[CONFIG_NOT_AVAILABLE] Configuration missing_key is not available. SQLSTATE: 42K0I
--------------------------------------------------------------