https://community.databricks.com/t5/data-engineering/py4j-protocol-py4jjavaerror-an-error-occurred-while-calling-o359/m-p/53933#M29930 <P>Hi!<BR />We are creating table in streaming job every micro-batch using spark.sql('create or replace table ... using delta as ...') command. This query includes combining data from multiple tables.</P><P>Sometimes our job fails with error:</P><LI-CODE lang="python">py4j.Py4JException: An exception was raised by the Python Proxy. Return Message: Traceback (most recent call last): py4j.protocol.Py4JJavaError: An error occurred while calling o359.sql. : java.util.NoSuchElementException: key not found: Filter (isnotnull(uuid#42326735) AND isnotnull(actor_uuid#42326740))</LI-CODE><P>How can I stop getting this error or add try/except statement to handle it? I was trying this, but it doesn't seem to work and the job continue failing:</P><LI-CODE lang="markup">from py4j.protocol import Py4JError, Py4JJavaError try: spark.sql.(query) except Exception as e: ## some code except Py4JError as e: ## some code except Py4JJavaError as e: ## some code</LI-CODE> Mon, 27 Nov 2023 09:44:03 GMT deng_dev 2023-11-27T09:44:03Z https://community.databricks.com/t5/data-engineering/py4j-protocol-py4jjavaerror-an-error-occurred-while-calling-o359/m-p/53933#M29930 <P>Hi!<BR />We are creating table in streaming job every micro-batch using spark.sql('create or replace table ... using delta as ...') command. This query includes combining data from multiple tables.</P><P>Sometimes our job fails with error:</P><LI-CODE lang="python">py4j.Py4JException: An exception was raised by the Python Proxy. Return Message: Traceback (most recent call last): py4j.protocol.Py4JJavaError: An error occurred while calling o359.sql. : java.util.NoSuchElementException: key not found: Filter (isnotnull(uuid#42326735) AND isnotnull(actor_uuid#42326740))</LI-CODE><P>How can I stop getting this error or add try/except statement to handle it? I was trying this, but it doesn't seem to work and the job continue failing:</P><LI-CODE lang="markup">from py4j.protocol import Py4JError, Py4JJavaError try: spark.sql.(query) except Exception as e: ## some code except Py4JError as e: ## some code except Py4JJavaError as e: ## some code</LI-CODE> Mon, 27 Nov 2023 09:44:03 GMT https://community.databricks.com/t5/data-engineering/py4j-protocol-py4jjavaerror-an-error-occurred-while-calling-o359/m-p/53933#M29930 deng_dev 2023-11-27T09:44:03Z https://community.databricks.com/t5/data-engineering/py4j-protocol-py4jjavaerror-an-error-occurred-while-calling-o359/m-p/135228#M50309 <P>Hi <a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/95043">@deng_dev</a>&nbsp;,</P><P>Did you discover any way to raise this error gracefully? I'm facing the same error when running the kinesis stream. Although I'm aware of what the error is but my intent is to raise and log the error gracefully&nbsp;</P> Fri, 17 Oct 2025 10:50:46 GMT https://community.databricks.com/t5/data-engineering/py4j-protocol-py4jjavaerror-an-error-occurred-while-calling-o359/m-p/135228#M50309 sahilchavan 2025-10-17T10:50:46Z