A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems

Chen, Miaojiang; Liu, Wei; Wang, Tian; Zhang, Shaobo; Liu, Anfeng

doi:10.1016/j.knosys.2021.107660

Cited by 74 publications

(35 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the satellite time window characteristics, many researchers design algorithms to solve the scheduling problem of the visual time window constraints [12][13][14]. The resource scheduling process can generally be divided into task planning and resource allocation.…”

Section: Resource Scheduling Methods Based On Machine Learningmentioning

confidence: 99%

An Efficient Satellite Resource Cooperative Scheduling Method on Spatial Information Networks

Fan

Yang

et al. 2021

Mathematics

View full text Add to dashboard Cite

To overcome the low timeliness of resource scheduling problems in spatial information networks, we propose a method based on a dynamic reconstruction of resource request queues and the autonomous coordinated scheduling of resources. First, we construct a small satellite network and combine the graph maximum flow theory to solve the link resource planning problem during inter-satellite data transmission. In addition, we design a multi-satellite resource scheduling algorithm with minimal time consumption based on graph theory. The algorithm is based on graph theory to reallocate the resource request queue to satellites with idle processing resources. Finally, we simulate the efficient resource scheduling capability in the spatial information network and empirically compare our approaches against two representative swarm intelligence baseline approaches and show that our approach has significant advantages in terms of performance and time consumption during resource scheduling.

show abstract

Section: Resource Scheduling Methods Based On Machine Learningmentioning

confidence: 99%

An Efficient Satellite Resource Cooperative Scheduling Method on Spatial Information Networks

Fan

Yang

et al. 2021

Mathematics

View full text Add to dashboard Cite

show abstract

“…Mobile-edge computing (MEC) offers execution resources such as storage, computations, etc., close to the users (in a network), that can be utilized to deliver services, as well as store and process the content. Artificial intelligence techniques help to further improve the performance of MEC [ 85 , 86 ]. Fifth-generation and MEC technologies together have the potential to greatly enhance performance and allow the real-time processing of large volumes of data.…”

Section: Insights Into Communication Standards and Technologiesmentioning

confidence: 99%

Communication Technologies for Interoperable Smart Microgrids in Urban Energy Community: A Broad Review of the State of the Art, Challenges, and Research Perspectives

Reddy

Kumar

Chakravarthi

2022

Sensors

View full text Add to dashboard Cite

In modern urban energy communities, diverse natured loads (homes, schools, hospitals, malls, etc.) are situated in the same locality and have self-electricity generation/management facilities. The power systems of these individual buildings are called smart microgrids. Usually, their self-electricity generation is based on renewable energy sources, which are uncertain due to their environmental dependency. So, the consistency of self-energy generation throughout the day is not guaranteed; thus, the dependency on the central utility grid is continued. To solve this, researchers have recently started working on interoperable smart microgrids (ISMs) for urban communities. Here, a central monitoring and control station captures the energy generation/demand information of each microgrid and analyzes the availability/requirement, thereby executing the energy transactions among these ISMs. Such local energy exchanges among the ISMs reduce the issues with uncertain renewable energy and the dependency on the utility grid. To establish such useful ISMs, a well-established communication mechanism has to be adopted. In this view, this paper first reviews various state-of-the-art developments related to smart grids and then provides extensive insights into communication standards and technologies, issues/challenges, and future research perspectives for ISM implementation. Finally, a discussion is presented on advanced wireless technology, called LoRa (Long Range), and a modern architecture using the LoRa technology to establish a communication network for ISMs is proposed.

show abstract

“…Since problem (11) contains equality constraints and inequality constraints, for convenience, we defined two feasible region:…”

Section: Ddgd Optimization Algorithmmentioning

confidence: 99%

A novel differential dynamic gradient descent optimization algorithm for resource allocation and offloading in the COMEC system

Chen

et al. 2022

Int J of Intelligent Sys

Self Cite

View full text Add to dashboard Cite

The multiuser cooperative offloading mobile edge computing (COMEC) system has attracted much attention because it can realize delay-sensitive tasks. However, in the coupling optimization of offloading decision and resource allocation, the existing numerical optimization algorithms are difficult to obtain high-quality optimization solutions. In this paper, we propose a differential dynamic gradient descent (DDGD) optimization algorithm to solve the above optimization problems. DDGD algorithm decomposes the constrained NP-hard optimization problem into two network layers and integrates the constraint function into a larger end-to-end training network. These two-layer networks encode the dependencies and optimization constraints between parameter hidden states, which cannot be captured by a numerical optimization model or a full connection layer neural network. Because the ring learning and self-repeating learning architecture are adopted and the information is stored in the differential dynamics network, the proposed algorithm can achieve better and more intelligent decision-making in searching the solution trajectory without setting accurate parameters in advance and

show abstract

A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems

Cited by 74 publications

References 46 publications

An Efficient Satellite Resource Cooperative Scheduling Method on Spatial Information Networks

An Efficient Satellite Resource Cooperative Scheduling Method on Spatial Information Networks

Communication Technologies for Interoperable Smart Microgrids in Urban Energy Community: A Broad Review of the State of the Art, Challenges, and Research Perspectives

A novel differential dynamic gradient descent optimization algorithm for resource allocation and offloading in the COMEC system

Contact Info

Product

Resources

About