I found similar issue
https://kb.databricks.com/python/job-fails-with-not-enough-memory-to-build-the-hash-map-error

Looks like the reason of error is a bug in new Databricks feature which is called executor-side broadcast (ebj, executor broadcast join) which was introduced in DBR 11.3.

Unfortunately could not find the way how to disable this feature, so keeping AQE disable so far.