Recently, I've been working on optimization projects and obvious first topic always discussed with the client is monthly spend - current, target, gap. LHO is indispensable tool for monitoring and measuring performance, but as important as it is, it does not show important metric - cost per record (or byte) processed by job. CPR is not too hard to calculate in Lakehose, it refers to the cost associated with managing, storing, or processing individual data records, can offer valuable insights into an organization's operational maturity. The correlation between price per record and operational maturity helps businesses understand their efficiency, technology investments, and scalability, shedding light on opportunities for cost optimization and growth. In my experience it was hard to stir the clients into this direction.
Any opinions?
Thanks
