cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Instances are not being terminated in time (extra AWS costs)

mroy
Contributor

For a few days we have been trying to figure out why our AWS costs suddenly went up around March 20th, and we just found the answer: the EC2 instances are left in an unterminated state for a couple of minutes at the end of each run! 😱

This is a very serious bug, and I'm sure we're not the only customers being affected by this. 💸

We have many jobs which run very often (every 15 minutes, 30 minutes, hourly, etc.), and all of these incur an extra cost because of this bug (more than double the cost in some cases). It affects all jobs, but the impact is much less for those which run less often.

This screenshot is very explicit (y axis is the costs). It is from Cloudability, which we use to manage our AWS costs.

mroy_0-1712023586396.png

Please fix this!

1 ACCEPTED SOLUTION

Accepted Solutions

mroy
Contributor

Nevermind, this was actually due to a reservation that expired. 🤦‍

View solution in original post

1 REPLY 1

mroy
Contributor

Nevermind, this was actually due to a reservation that expired. 🤦‍

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group