Characterizing spot price dynamics in public cloud environments

Abstract

The surge in demand for utilizing public Cloud resources has introduced many trade-offs between price, performance and recently reliability. Amazon's Spot Instances (SIs) create a competitive bidding option for the public Cloud users at lower prices without providing reliability on services. It is generally believed that SIs reduce monetary cost to the Cloud users, however it appears from the literature that their characteristics have not been explored and reported. We believe that characterization of SIs is fundamental in the design of stochastic scheduling algorithms and fault tolerant mechanisms in public Cloud environments for spot market. In this paper, we have done a comprehensive analysis of SIs based on one year price history in four data centers of Amazon's EC2. For this purpose, we have analyzed all different types of SIs in terms of spot price and the inter-price time (time between price changes) and determined the time dynamics for spot price in hour-in-day and day-of-week. Moreover, we have proposed a statistical model that fits well these two data series. The results reveal that we are able to model spot price dynamics as well as the inter-price time of each SI by the mixture of Gaussians distribution with three or four components. The proposed model is validated through extensive simulations, which demonstrate that our model * Corresponding author. Telephone: +61-2-9685 9181; Fax: +61-2-9685 9245Email address: b.javadi@uws.edu.au (Bahman Javadi)Preprint submitted to Future Generation Computer Systems May 6, 2012 exhibits a good degree of accuracy under realistic working conditions.

Optimal Pricing and Service Provisioning Strategies in Cloud Systems: A Stackelberg Game Approach

“…A reverse engineering analysis in [15] found that Amazon sets their prices at random from within a tight price interval via a dynamic hidden reserve price. A statistical analysis and modeling of Amazon spot price dynamics is in [16]. Differently from our assumption, EC2 spot instances are priced the same to all its users.…”

OptiSpot: minimizing application deployment cost using spot cloud resources

“…Some works (e.g., [13,14,28,30,31]) focus on understanding the price dynamics to generate price predictions that can be used to make cost-effective provisioning decision. Other works (e.g., [2,29,32]) focus on providing bidding strategies that are specific for spot instances.…”

On the Financification of Cloud Computing: An Agenda for Pricing and Service Delivery Mechanism Design Research

“…Also, managers will find it beneficial to understand more fully how to do effective statistical modeling of spotprice cloud computing instances in public markets (Javadi et al 2011) and how spot prices change in these kinds of market environments (Javadi et al 2013). In future markets, data analytics for different kinds of cloud computing instances, and how demand and supply interact over time in the presence of managerial choices on pricing for them, will become strategic capabilities for cloud computing vendors and their clients.…”