I'm running a scheduled workflow with a dbt task on Azure Databricks. We want to export the dbt-output from the dbt task to a storage container for our Slim CI setup and data observability.

The issue is, that the Databricks API (/api/2.1/jobs/runs/get-output) that should return a dbt_output-object with a temporary link to access the compressed artifacts from the run, always is empty while returning logs, metadata objects etc as expected. This makes little sense, because the log (stdout) from the run clearly states that the file has been created and exported to the job-result in the manged storage. The compressed file exists, but I have no way of accessing it. 

I have tried both with rest API, CLI and python SDK, with my personal token as well as with the service principal that runs the workflow. I have also created a new workflow, all with the same results: dbt_output is not there.

Would greatly appreciate any pointers to what I'm missing!