Were you able to find any solution to the problem?

I am also having the similar use-case where I need to run multiple run_job_task and everytime it is spinning up new cluster of its own that is defined in child job.

I am not able to find any relevant solution for the described problem in the databricks python sdk.