Our infra team told me we might face strange databricks bug. It happens only in our team workspace. Other teams do not experience bug with clusters that have identical configuration.

Also when I run jobs with identical settings as in our cluster, but Policy: Job Compute - Single node and Access mode: Dedicated (formerly Single user) – issue dissapears.

But when I use here Access mode: Standard (formerly: Shared) – as in our cluster – problem persist.