Just want to post this issue we're experiencing here in case other people are facing something similar. Below is the wording of the support ticket request I've raised:
SQL code that has been working is suddenly failing due to syntax errors today. There have been no changes to the Databricks runtime we use (12.2).
The SQL code that is failing interrogates tables with '>' in the field names. The error is produced when you query these tables in a subquery or CTE and then SELECT from the subquery or CTE. Our code uses backticks to enclose these field names already.
Sample error message:
[PARSE_SYNTAX_ERROR] Syntax error at or near '>'.(line 1, pos 5) == SQL == event>eventData>identityState>customerId -----^^^