Databricks Community

Einsatz · 01-02-2025

I have a Unity Catalog Enabled cluster with Node type Standard_DS4_v2 (28 GB Memory, 8 Cores). When "Use Photon Acceleration" option is disabled spark.executor.memory is 18409m. But if I enable Photon Acceleration it shows spark.executor.memory as 46...

Einsatz · 01-03-2025

@VZLA/@Walter_C Thanks for the quick answers! I understand that the Photon engine requires memory for its optimization tasks, and this memory usage impacts the executor memory.I’ve got few more questions, and I’d really appreciate it if you could h...

Databricks Community

User Stats

User Activity

Photon enabled UC cluster has less executor memory(1/4th) compared to normal cluster.

Re: Photon enabled UC cluster has less executor memory(1/4th) compared to normal cluster.