Thanks everyoneDo you have a sample ini script that access secrets. It’s more like a syntax issuei managed with spark ini config of the cluster rather than through ini script
Next thing you can do is if its a full load goto the underlying storage and delete the physical delta table and do a full reload. if you dont have too much time to research on options
one way to manage is make the cluster permission only to can restart and then use an init script to install libraries on start up so that users wont install libraries on the fly.
The most important aspect is your experiment can track the version of the data table. So during audits you will be able to trace back why a specific prediction was made.
