How do I programmatically get the database name in a DLT notebook?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-21-2022 10:19 AM
I have configured a database in the settings of my DLT pipeline. Is there a way to retrieve that value programmatically from within a notebook? I want to do something like
spark.read.table(f"{database}.table")
Labels:
- Labels:
-
DLT
-
DLT Pipeline
-
DLTNotebook
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-28-2022 11:40 PM
You could also set it as a config value as database:value, and then retrieve it in the notebook using spark.conf.get().
I'm hoping they update DLT to support UC, and then allow us to set database/schema at the notebook level in @dlt.table(schema_name, table_name).
