Hi Everyone,
We built Gradient, a tool to automatically optimize and monitor Databricks jobs to hit your business objectives of cost or runtime.
Gradient works by applying a reinforcement ML model to automatically learn and custom tune your jobs clusters to reduce costs and hit SLAs.
https://www.synccomputing.com
We also recently released new jobs level metric timeline which shows how various paramters (data size, disk spill, etc) change over time, which has be extremely popular with our users.
We'd love your feedback!
