I came across Databricks last year when I was working on a client project. Client had data in large volume (over 100m rows) and after transforming the data it eventually went up to 50 billion records. Databricks helped my team to drastically improved the speed of the BI tool with such big dataset. Today at the conference I learned that Databricks is much more powerful than โmaking things fasterโ. Iโm excited to learn the best practices across all elements that can be used in my day to day work for my clients.
