topic Re: Error handling/exception handling in NOtebook in Data Engineering

Error handling/exception handling in NOtebook

KuldeepChitraka — Sun, 25 Dec 2022 11:03:40 GMT

What is a common practice to to write notebook which includes error handling/exception handling.

Is there any example which depicts how notebook should be written to include error handling etc.

Re: Error handling/exception handling in NOtebook

Ajay-Pandey — Sun, 25 Dec 2022 12:35:29 GMT

Hi @Kuldeep Chitrakar you can use try and catch to handle the exception

Re: Error handling/exception handling in NOtebook

ramravi — Sun, 25 Dec 2022 15:28:57 GMT

it's just a simple try except code, something like this:

results = {}
 
were_errors = False
 
for script_name in ['script1', 'script2', 'script3']:
 
  try:    
 
    retValue = dbutils.notebook.run(script_name)
 
    results[script_name] = retValue
 
  except Exception as e:
 
    results[script_name] = "Error: {e}"
 
    were_errors = True
 
 
 
if were_errors:
 
  log failure # you can use data from results variable
 
else:
 
  log success

Re: Error handling/exception handling in NOtebook

Aviral-Bhardwaj — Mon, 26 Dec 2022 04:40:41 GMT

use try catch

Re: Error handling/exception handling in NOtebook

Meghala — Mon, 26 Dec 2022 10:53:35 GMT

runtime looks for handlers (try-catch) that are registered to handle such exceptions