Vivian_Wilfred
Databricks Employee
Databricks Employee

Hi @Arumugam Ramachandran​ seems like you have a spark config set on your DLT job cluster that allows only python and SQL code. Check the spark config (cluster policy).

In any case, the python code should work. Verify the notebook's default language, it should not be scala.

imageCheck this doc for additional details.

https://docs.databricks.com/notebooks/notebooks-manage.html#execution-contexts

Mark a comment as 'best answer' to resolve the query, thanks.