External functions on a SQL endpoint

Vegard_Stikbakk — Fri, 25 Mar 2022 14:49:21 GMT

want to create an external function using CREATE FUNCTION (External) and expose it to users of my SQL endpoint. Although this works from a SQL notebook, if I try to use the function from a SQL endpoint, I get "User defined expression is not supported on a SQL endpoint." Specifically, the function is created by doing this, like the example in the CREATE FUNCTION (External) docs says.

CREATE FUNCTION f1 AS 'SimpleUDF' USING JAR '/dbfs/FileStore/udf.jar'

Screenshot of error message

The JAR lives in DBFS. Maybe the reason why this doesn't work is that a SQL endpoint doesn't have access to DBFS? I haven't been able to find anything about this, though.

I hope someone can help!

Re: External functions on a SQL endpoint

Hubert-Dudek — Mon, 28 Mar 2022 14:22:07 GMT

It is separated runtime https://docs.databricks.com/sql/release-notes/index.html#channels so it seems that it is not yet supported.

There is CREATE FUNCTION documentation but it seems that it is support only SQL syntax https://docs.databricks.com/sql/language-manual/sql-ref-syntax-ddl-create-sql-function.html

topic External functions on a SQL endpoint in Data Engineering

External functions on a SQL endpoint

Re: External functions on a SQL endpoint