Using Python UDF in Delta live table

Sabtout — Mon, 18 Sep 2023 12:32:34 GMT

Hello,

I tried running a python UDF in a Delta Live Table workflow in Advanced mode but it did not run and gave the "Python UDF is not supported in your environment" error.

Can I get a clear picture if the Python External UDFs are supported or not?

Re: Using Python UDF in Delta live table

Sabtout — Mon, 18 Sep 2023 15:13:55 GMT

Hi @Retired_mod

I ran this SQL query in my Catalog (I'm using Unity Catalog) :

CREATE OR REPLACE FUNCTION cat_projint_dev.silver.GetEditor(prompt STRING)

RETURNS STRING

LANGUAGE PYTHON

AS $$

print(prompt)

$$

Then I ran a Delta Live Table workflow using Unity Catalog plugged in my silver catalog like this :

@dlt.table(name="editors_bronze", temporary = True)

def editors_bronze():

    return spark.sql("SELECT prompt,cat_projint_dev.bronze.GetEditor(prompt) AS EDITOR_NAME FROM LIVE.editors_temp_bronze")

And then I'm having this issue :

[FEATURE_UNAVAILABLE] Python UDF is not supported in your environment. To use this feature, please contact Databricks Support.

Thank you for your help ! 🙂

topic Using Python UDF in Delta live table in Data Engineering

Using Python UDF in Delta live table

Re: Using Python UDF in Delta live table