Is it possible to temporarily disable Photon?

I have a large workload that greatly benefits from Photon apart from a specific operation therein that is actually slowed by Photon. It's not worth creating a separate cluster for this operation however, so I'm wondering if it's possible to programmatically disable Photon (via Spark config or otherwise) and reenable it again later.