indeed you have to take into account the spark version. Spark2 is not supported anymore by databricks.

This link might help.

About the toList method: it works fine here. I think the issue here is that the clicked_at column is not considered to be a valid date column.