Hi @William_Scardua,

It is advisable to consider using Python (or PySpark) due to Spark's comprehensive API support for Python. Furthermore, Databricks currently supports Delta Live Tables (DLT) with Python, but does not support Scala at this time. Additionally, you can extend PySpark with various data quality libraries written in Python, such as Great Expectations.

Regards,
Hari Prasad