xiangzhu
Contributor III

During this weekend, I found a workaround by leveraging the databaricks jobs api.

It works but I must provide credentials, whereas I'm looking forward to a solution without credentials since I'm already in a job run.