I should make some changes in each records. After that, I write them into MSSQL. So looks like the Databricks is better to use it...

I just needed to speed up to write big dataframe into MSSQL db and fix the error.