We are hoping to use "spark connect" in the next phase of work and I've heard it isn't trivial to use that feature with "jobs clusters".  I will explore both approaches, but I'm guessing that databricks had invested more energy into making that  feature compatible with the "all-purpose clusters".   So that is my starting point right now.

Where jobs clusters are concerned, I don't have high expectations.  I had asked in the past and was told that "spark connect" was primarily designed to be used on all-purpose clusters.