Identity Column Issues

AJK1 — Fri, 19 May 2023 15:17:29 GMT

Hello.

I'm experiencing what I'm believe are pretty severe (current) shortcomings regarding Identity columns in Databricks.

I'm defining a SQL table using spark SQL - the table creates as exepcted; I've tried using both column definitions for this identity column.

If I define the table using Generated Always I get the following error when inserting records:

I'm certain I am not providing any column values targeted for the identity column within the insert statement.

If I define the table using Generated By Default this statement executes and inserts data, but the identity column is completely NULL:

For context, I'm on Azure DBR 12.2 LTS. I've tried on the 13.0 DBR, but still nothing.

Anything obvious I'm missing?

topic Identity Column Issues in Data Engineering