We also tried multiple configurations including:

  • report_type = row

  • report_type = all

  • report_type = schema

But in all cases, the Spark job eventually gets stuck at some point while the cell keeps running continuously without completing.

Akshay Petkar