How to use SQL UDFs for Delta Live Table pipelines?

[Gim]

I've been searching for a way to use a SQL UDF for our DLT pipeline. In this case it is to convert a time duration string into INT seconds. How exactly do we use/apply UDFs in this case?

[daniel_sahal · Accepted solution]

@Gim

You can create Python UDF and then use it in SQL.

https://docs.databricks.com/workflows/delta-live-tables/delta-live-tables-cookbook.html#use-python-u...

[Gim]

Thanks! It wasn't initially clear to me exactly how to actually link separate notebooks in a DLT pipeline. I assume SQL UDF works as well with that same setup? The current transformations are not as complex - just needed to shorten them for reusability.