A survey on software methods to improve the energy efficiency of parallel computing

Abstract

Energy consumption is one of the top challenges for achieving the next generation of supercomputing. Codesign of hardware and software is critical for improving energy efficiency (EE) for future large-scale systems. Many architectural power-saving techniques have been developed, and most hardware components are approaching physical limits. Accordingly, parallel computing software, including both applications and systems, should exploit power-saving hardware innovations and manage efficient energy use. In addition, new power-aware parallel computing methods are essential to decrease energy usage further. This article surveys software-based methods that aim to improve EE for parallel computing. It reviews the methods that exploit the characteristics of parallel scientific applications, including load imbalance and mixed precision of floating-point (FP) calculations, to improve EE. In addition, this article summarizes widely used methods to improve power usage at different granularities, such as the whole system and per application. In particular, it describes the most important techniques to measure and to achieve energy-efficient usage of various parallel computing facilities, including processors, memories, and networks. Overall, this article reviews the state-of-the-art of energy-efficient methods for parallel computing to motivate researchers to achieve optimal parallel computing under a power budget constraint.

Energy-Aware High-Performance Computing: Survey of State-of-the-Art Tools, Techniques, and Environments

“…Consequently, we add analysis on energy and power control methods in our analysis. e study in [7] includes a survey of software methods for improving energy efficiency in parallel computing from a slightly different perspective; namely, it focuses on increasing energy efficiency for parallel computations. It discusses components such as processor, memory, and network, from application to the system level and elements such as load and mixed precision computations in parallel computing.…”

A Taxonomy and Future Directions for Sustainable Cloud Computing

“…For example, scheduling algorithm for Map Reduce model follows different approach compared to other models like workflow, web application, streaming application, graph processing etc. To make the infrastructure sustainable and environment eco-friendly, there is a need of green ICT-based innovative applications [142]. Effective design of cloud applications contains APIs or services.…”

“…To solve the heating problem of CDCs, thermal-aware scheduling is designed to minimize cooling setpoint temperature, hotspots and thermal gradient. Thermal-aware scheduling is better than heat modelling [142]. Thermal-aware scheduling based on heat modelling performs computational scheduling of workload.…”

Analyzing energy/performance trade-offs with power capping for parallel applications on modern multi and many core processors

“…It is important in particular for execution that is energy efficient for various levels of utilization [4]. The authors of [5] investigate software methods aimed at improving energy efficiency in parallel computing. In particular it focuses on load imbalance, mixed precision in floating-point operations.…”