Spot instances – Running for 100+ days without termination

Paddy Raghavan | 28th Feb, 2017

What are Spot Instances?

Spot instances are deeply discounted instances provided by AWS at 80-90% cheaper rates when compared to on-demand instances. Performance wise, spot instances are comparable to on-demand instances. However, spot instances work on demand-supply economics and if outbid the instance would be taken immediately (with a 2 min termination notice)

Batchly is a SaaS solution that balances your AWS EC2 workloads over on-demand, spot and reserved instances to achieve up to 85% savings on your EC2 costs.

We get questions around how frequently do we lose spot instances when provisioned through Batchly. The good news is that we are able to retain the spot instances we launch for a long time. We have been running multiple tests across different regions and we have seen instances launched by Batchly running successfully for over 100 days (130 days as of today!) without the instances getting terminated.

How is Batchly able to retain Spot Instances?

Batchly uses historical data and prediction modeling to identify the right bidding strategies and the right instance types and this varies by time of day, availability zones, AWS region among other things.

But what if AWS still takes away the Spot instance?

Batchly has a multi layered defence strategy to ensure that your application uptime is guaranteed.

  • Batchly chooses a spot bidding strategy based on historical data and prediction modeling as mentioned above.That’s our first line of defense.
  • It continuously monitors instance availability and proactively swaps instances (to another spot instance or on-demand instance in the same or different AZ) if they have a higher probability of being taken away. That’s our second line of defense.
  • Batchly also has the ability to run a small fleet of instances (set during job configuration) as on-demand instances. That’s our third line of defense.

These strategies ensure that with Batchly, you could bring the cost efficiencies of spot instances to every layer of your application without worrying about application uptime.

3 thoughts on “Spot instances – Running for 100+ days without termination”

Leave a Reply

Your email address will not be published. Required fields are marked *

'