@andreapeterson, this is likely because the CSS invert filter is applied to certain output types. We have an existing internal ticket(PROD-51027) for this issue, and being worked on. 

Either we have a plan to add a setting/toggle for this, which means either invert the colour or keep showing the white background while the site is in dark mode.