Energy efficiency in big data complex systems: a comprehensive survey of modern energy saving techniques

Abstract

IntroductionDue to the advancement in computer technology, the computer systems have become widespread and complex. This complex arrangement of the system results into a complex adaptive system (CAS). A huge increase in the scale and complexity of the systems have been observed (Niazi and Laghari 2012) since from last few years. CAS exists in different forms. The management of such systems is carried out with efficient algorithms and is only controlled by different computational methods (Batool and Niazit 2015). Big data is one of the examples of such complex systems. CAS is comprised of large entities and components which require interaction and adoption in performing certain operations. The nature of the big data is more or less the same as complex systems. In other words, big data is one of the forms of the complex systems. Most of the CASs are tied to AbstractThe growing need of computation and processing has led to the generation of data centers. These data centers are usually comprised of hundreds of thousands of servers and other components. This complicated arrangement of the systems lead to the adoption of complex systems. Complex systems prevail in our society as combination of lots of entities, e.g., immune system, human brain and ecosystems. The adoption and interaction of the entities is possible through nonlinear interactions. The interaction between the components of the complex system is carried out in distributed fashion. Big data which is comprised of thousands of machines is also considered to be a form of complex adaptive systems which makes use of large entities, components and nonlinear interactions with each other. The development of such a complex systems raises certain challenges. Apart from management, energy is the most concerned one which is the core discussion of this research. This paper, surveys the state of the art on modern tools, techniques, architectures and algorithms which has been proposed and deployed to achieve energy efficiency in big data over the period of 2007-2015. We group existing approaches aimed at achieving energy efficiency in the complex paradigm of big data. In this categorization, we aim to provide an easy and concise view of the underlined model adapted by each approach in the context of big data. which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Majeed and Shah Complex Adapt Syst Model (2015) 3:6 the concept of our society, i.e., immune system, human brain (neuron structure), ecosystem and human societies. REVIEWBig data is providing numerous services and infrastructures to the companies and has opened new research directions in the field of computer science. Most of the current applications of the cloud computing uses distributed computing with varying degree of connectivity and interaction. Big data is providing computation and efficient processing to millions of user...

An Optimized Framework for Energy-Resource Allocation in a Cloud Environment based on the Whale Optimization Algorithm

“…This algorithm is applied mainly in two phases, where the first phase deals in limiting the violations of SLA while the second phase comprises relocating the VMs and merging them in lesser PMs that are active. Majeed et al [ 26 ] has done a survey on various techniques that can help to reduce energy consumption in the cloud environment. Various applications over the cloud consume high amount of energy but using integrated techniques and this way energy consumption can be reduced.…”

A large data processing algorithm for energy efficiency in a heterogeneous cluster

“…Epa (US Environmental Protection Agency) issued a report statement in 2006, the total electricity consumption of American IT agencies was 61 billion KWh, the electricity bill alone is $4.5 billion [5]- [7]. So that's a concern Big data storage and processing performance must also be used for energy consumption Give enough attention [8].…”

A Systematic Literature Review of the Impact of Complexity Theory on Applied Economics

“…Aeeni and Saeedikiya (2019);Balint et al (2017);Colander et al (2010);;Gaffeo and Tamborini (2011);Green and Newth (2001);Majeed and Shah (2015);Monasterolo et al (2019);…”