Is the Secrets API 2.0 not applied to Delta Live Tables configurations? I understand that the Secrets API 2.0 is in public preview and this use case may not be supported, yet. I tried the following and both do not work for the stated reasons.
In a DLT configuration JSON under the "configuration" section, this is not valid as it is not valid JSON:
"credentials": {{secrets/my-creds/service-credentials}},
And this is valid JSON, but is not replaced by the Secrets API. The curly braces and full string are loaded into my Spark environment.
"credentials": "{{secrets/my-creds/service-credentials}}",
I am able to load the secret with the following code in a cell in a DLT notebook. So, this is a valid workaround, but I would like to have it in the DLT config.
a = dbutils.secrets.get(scope="my-creds", key="service-credentials")
spark.conf.set("credentials", a)