Callback bound method error

[Henrik_]

 When executing a withColumn (running on DBR 14.3 LST) I get this error:

Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7feda2b2efb0>> (for post_run_cell):

How should this be interpreted? 

[LK8]

@Henrik_ this issue may occur due to cluster type, please change cluster type to single user cluster

thanks

[TjommeV-Vlaio]

We have the same issue using a shared cluster running DBR 14.3:

Code executed: 

dfNew = dfTmp.withColumn(HashKeyColumnName, F.sha2(F.concat_ws("||", *ColumnList), 256))

Error received: 

Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7fb0501caef0>> (for post_run_cell):

Issue triggering this error: dfTmp contains columns with ARRAY<> datatypes

Main issue: this error is in a try/except block which does not catch the error

Using a single user cluster is not an option