The best way is to test based on Data Size,Job Complexity,Frequency.Test with small data set and then scale up based on needs.for exampleTo configure a Databricks cluster for processing 100 GB of data, you must consider:Data size: 100 GB is moderate;...