As far as I know, in PySpark, exceptions raised in the JVM side are wrapped and sent to the Python driver, where they appear as PySparkException (or its subclasses). And during this conversion, some information might be lost. I tried catching the exception using  StreamingQueryException, since the documentation says that awaitTermination() throws this exception. The error is caught; however, when I try to access ex.getErrorClass(), ex.getSqlState(), and ex.getMessageParameters(), they are all None. Could this be related to the exception casting from PySpark to Python that I mentioned above? If so, what are my other options here?