New trends in parallel and distributed simulation: From many-cores to Cloud Computing

Abstract

Recent advances in computing architectures and networking are bringing parallel computing systems to the masses so increasing the number of potential users of these kinds of systems. In particular, two important technological evolutions are happening at the ends of the computing spectrum: at the "small" scale, processors now include an increasing number of independent execution units (cores), at the point that a mere CPU can be considered a parallel shared-memory computer; at the "large" scale, the Cloud Computing paradigm allows applications to scale by offering resources from a large pool on a pay-as-you-go model. Multi-core processors and Clouds both require applications to be suitably modified to take advantage of the features they provide. Despite laying at the extreme of the computing architecture spectrum -multi-core processors being at the small scale, and Clouds being at the large scale -they share an important common trait: both are specific forms of parallel/distributed architectures. As such, they present to the developers well known problems of synchronization, communication, workload distribution, and so on. Is parallel and distributed simulation ready for these challenges? In this paper, we analyze the state of the art of parallel and distributed simulation techniques, and assess their applicability to multi-core architectures or Clouds. It turns out that most of the current approaches exhibit limitations in terms of usability and adaptivity which may hinder their application to these new computing architectures. We propose an adaptive simulation mechanism, based on the multi-agent system paradigm, to partially address some of those limitations. While it is unlikely that a single approach will work well on both settings above, we argue that the proposed adaptive mechanism has useful features which make it attractive both in a multi-core processor and in a Cloud system. These features include the ability to reduce communication costs by migrating simulation components, and the support for adding (or removing) nodes to the execution architecture at runtime. We will also show that, with the help of an additional support layer, parallel and distributed simulations can be executed on top of unreliable resources.

Toward a New Massively Distributed Virtual Machine based Cloud Micro-Services Team Model for HPC: SPMD Applications

“…In [21] the authors presented the cloud concept and its emerged services that deal with the IoT trends, and they notice also that the applications with complex data-intensive computations are the best candidate to take advantages of cloud computing. Therefore, by applying the parallel and distributed simulation on cloud, the performance of these applications depends on the applied synchronization algorithms [22]. Our approach considers the performance of the HPC applications which are implemented on cloud architectures using micro-services, and deals with intensive computing units communication.…”

Multi-level simulation of Internet of Things on smart territories

“…Smart Shire Simulator (S 3 ) is a prototypal simulator based on the GAIA/ARTÌS simulation middleware [24,26]. ARTÌS permits the seamless sequential/parallel/distributed execution of large scale simulation runs using different communication approaches (e.g.…”

“…An alternative is to implement a parallel simulation [24]. In this case, the simulator uses two or more of the available CPU cores in the execution architecture to process the simulation evolution.…”

Cloud-based Geophysical Inversion Modeling Using GNU Octave and MatlabMPI on Amazon EC2

“…Simulation can be very demanding in terms of computational resources, for example when dealing with large and detailed models. Parallel and distributed simulation (PADS) aims at studying methodologies and techniques for defining and executing simulation models on parallel and distributed computing architectures [2]. In cloud computing, the computing resources are paid for per usage and may expand or shrink based on demand [3].…”