pawelmitrus
Contributor

Yeah, this is all I've got. The things I should also mention:

  • databricks runtime 10.4 LTS
  • I have disabled AQE

It looks like databricks have some kind of approach of creating jobs / stages in the way that:

  • start with 1
  • multiply by 4, if not enough then...
  • multiply by 5, if not enough then...
  • multiply by 5, if not enough then...
  • take the rest

so eventually it is (1, 4, 20, 100, 75) = 200