I came across Databricks last year when I was working on a client project. Client had data in large volume (over 100m rows) and after transforming the data it eventually went up to 50 billion records. Databricks helped my team to drastically improved...
