Lakshay
Databricks Employee
Databricks Employee

It seems that all your csv files are present under one folder and since you are able to union them, all these files must have same schema as well.

Given the above conditions, you can simply read all the data by referring the folder name instead of referring to each file individually.