Im having difficulty carrying out logging inside a foreachbatch.
Seems that all logging outside the foreachbatch works as expected, but inside they are only visable from the spark UI in driver logs. Is there a way to get this to work (inc serverless)?
