This is a super interesting post. I came across this article while I was flabbergasted by the bad results of my tests on ThreadPoolExecutor. But I cannot imagine how I can replace iterating over a list with datasets names and running a notebook with each name as a parameter with some of the other methods you talk about here. Even if there is no other solution for this, can you publish how you implemented your case above with the four approaches (the code itself)? This could help me and the other readers in finding better solution for our problems.
