Computation offloading through mobile vehicles in IoT-edge-cloud network

Abstract

With the developing of Internet of Things (IoT) and mobile edge computing (MEC), more and more sensing devices are widely deployed in the smart city. These sensing devices generate various kinds of tasks, which need to be sent to cloud to process. Usually, the sensing devices do not equip with wireless modules, because it is neither economical nor energy saving. Thus, it is a challenging problem to find a way to offload tasks for sensing devices. However, many vehicles are moving around the city, which can communicate with sensing devices in an effective and low-cost way. In this paper, we propose a computation offloading scheme through mobile vehicles in IoT-edge-cloud network. The sensing devices generate tasks and transmit the tasks to vehicles, then the vehicles decide to compute the tasks in the local vehicle, MEC server or cloud center. The computation offloading decision is made based on the utility function of the energy consumption and transmission delay, and the deep reinforcement learning technique is adopted to make decisions. Our proposed method can make full use of the existing infrastructures to implement the task offloading of sensing devices, the experimental results show that our proposed solution can achieve the maximum reward and decrease delay.

The Applicability of Reinforcement Learning Methods in the Development of Industry 4.0 Applications

“…, 32, 33, 38, 41, 45, 46, 51, 64, 68, 70, 72, 82, 83, 85, 86, 91, 94, 96, 100],[102, 104, 106-109, 128, 131, 135, 136, 140, 141, 145, 151, 158, 160],[164, 166, 168, 170, 173, 178, 179, 188, 191, 198, 200, 201, 203, 206, 207, 209, 215-218, 223, 230],[234-236, 239, 243-245, 248, 248],[251,252,254,255,257,272,275,277,279,284,286,288,293,299,300,302,304,305,[307][308][309],[311, 312, 315-318, 321, 323, 328-336, 340, 341, 343-351] Vehicle, unmanned aerial vehicle, drone, aircraft[10,68,79,90,91,151,161,170,181,183,197,217,220,223,228,229,232,244,257,259,266],[272, 277, 282, 299, 305, 309-311, 313, 320, 325, 336, 341, 352-354] …”