spark.conf.set("spark.scheduler.mode", "FAIR")
sc.setLocalProperty("spark.scheduler.pool", "pool1")

Please use the above conf setting to enable FAIR (round robin) mode instead of default FIFO.

Using the above example, you can also set a separate pool for each job/notebook.