06-27-2022 02:35 PM
Are you running this latest run on a single node still?
Do you have 2 TB in the S3 bucket you want fed into Databricks to do processing on the data and then any new data that ends up in that S3 bucket?
