Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-04-2025 12:58 AM - edited 12-04-2025 12:59 AM
@ManojkMohan as mentioned in the first post I already used dict(spark.conf.getAll()).get(key, default) where possible.
However the problem stands when importing modules, like:
- from dbacademy import dbgems
- from dbacademy.dbhelper import DBAcademyHelper, Paths, CourseConfig, LessonConfig
- from dbacademy.dbhelper.validations.validation_helper_class import ValidationHelper
I also tried to use the last release (Release v5.0.11 · databricks-academy/dbacademy), without success.
Finally, the idea of setting manually the missing keys with spark.conf.set is failing too, raising the same exception for the missing key:
--------------------------------------------------------------
--------------------------------------------------------------
--------------------------------------------------------------
spark.conf.set("missing_key", "default")
[CONFIG_NOT_AVAILABLE] Configuration missing_key is not available. SQLSTATE: 42K0I