Not able to catch structured streaming exception
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-25-2023 07:49 AM
I would like to catch and handle an exception in a structured streaming job.
The databricks notebook still displays the exception, regardless of added exception handling (see attached screenshot)
I guess that the exception is displayed by the cell output. Is it possible to ignore the stream display in the cell output?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-25-2023 07:58 AM
Hi,
Could you please expand the error section and paste it here?
Also, please tag @Debayan with your next comment which will notify me. Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-25-2023 08:28 AM
The notebook fails, even though I would like to catch that exception and return a different message to the caller. Hence, the notebook should end successfully.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-26-2023 08:21 AM
Hi, I understand, could you please also provide the last line of the error after scrolling down in the notebook cell?
