why this not able to go through?

[THIAM_HUATTAN]

https://textdoc.co/index.php/UFEQdwxWn60LtOVf

Error:

https://textdoc.co/index.php/3JisnHKGkvLIaAOF

[Hubert-Dudek · Accepted solution]

It would be best if you used Databricks ML runtime (in cluster settings), not the standard one.

[THIAM_HUATTAN]

yes, exactly, this is what I have figured it out yesterday, and it wasted so many of my hours troubleshooting it. But at least it is solved, thanks.

[THIAM_HUATTAN]

Hubert's suggestion is the solution. Thanks.

[THIAM_HUATTAN]

done.