I don´t see why you use databricks for this. There is no data transformations, only moving data from csv to a database.

Why don´t you do this with Data Factory?

The thing is: Databricks will not have issues processing this csv file, but when you write it to a database, that will become the bottleneck. You also have a cluster running which is basically mainly waiting.