Hello Hubert,

Thank you for the response.

I am not sure if it works for me.

I run in a loop the same notebook in a few times. Something like that:

spark.sparkContext.setLocalProperty("spark.scheduler.pool", "My_Notebook")
 
for row in data:
    notebook_results = dbutils.notebook.run("My_Notebook", 60, {"data": row})

And yet the time to start any notebook is several seconds.

Could you tell me what is wrong with this solution?

Best regards,

Łukasz