Using Python UDF in Delta live table
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-18-2023 05:32 AM
Hello,
I tried running a python UDF in a Delta Live Table workflow in Advanced mode but it did not run and gave the "Python UDF is not supported in your environment" error.
Can I get a clear picture if the Python External UDFs are supported or not?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-18-2023 07:58 AM - edited 09-18-2023 08:13 AM
Hi @Retired_mod
I ran this SQL query in my Catalog (I'm using Unity Catalog) :
CREATE OR REPLACE FUNCTION cat_projint_dev.silver.GetEditor(prompt STRING)
RETURNS STRING
LANGUAGE PYTHON
AS $$
print(prompt)
$$
Then I ran a Delta Live Table workflow using Unity Catalog plugged in my silver catalog like this :
@dlt.table(name="editors_bronze", temporary = True)
def editors_bronze():
return spark.sql("SELECT prompt,cat_projint_dev.bronze.GetEditor(prompt) AS EDITOR_NAME FROM LIVE.editors_temp_bronze")
And then I'm having this issue :
[FEATURE_UNAVAILABLE] Python UDF is not supported in your environment. To use this feature, please contact Databricks Support.
Thank you for your help ! 🙂
