Hi @calvinchan_iot, How are you doing today?

As per my understanding, It sounds like the error may be due to environment instability when running the UDF after enabling Unity Catalog. The [UDF_ERROR.ENV_LOST] error often points to the UDF execution environment crashing or failing to maintain a stable state. This could happen if the Unity Catalog environment restricts certain UDF operations or lacks resources needed for consistent execution. Consider rechecking UDF compatibility with Unity Catalog, as some operations may behave differently under its governance policies. You might also try scaling up resources or reconfiguring cluster settings to handle more intensive UDF executions. If the issue persists, ensure that library dependencies for UDFs are fully compatible with Unity Catalog, as mismatches can lead to crashes.

Give a try and let me know.

Regards,

Brahma