Transmission Network Dynamic Planning Based on a Double Deep-Q Network With Deep ResNet

Abstract

Based on a Double Deep-Q Network with deep ResNet (DDQN-ResNet), this paper proposes a novel method for transmission network expansion planning (TNEP). Since TNEP is a large scale and mixedinteger linear programming (MILP) problem, as the transmission network scale and the optimal constraints increase, the numerical calculation and heuristic learning-based methods suffer from heavy computational complexities in calculation and training. Besides, due to the black box characteristic, the solution processes of the heuristic learning-based methods are inexplicable and usually require repeated training. By using DDQN-ResNet, this paper constructs a high-performance and flexible method to solve large-scale and complex-constrained TNEP problem. Firstly, we form a two-objective TNEP model, in which one objective is to minimize the comprehensive cost, and another objective is to maximize the transmission network reliability. The comprehensive cost takes into account the expansion cost, the network loss cost, and the maintenance cost. The transmission network reliability is evaluated by the expected energy not served (EENS) and the electrical betweenness. Secondly, from the TNEP model, the TNEP task is constructed based on the Markov decision process. By abstracting the task, the TNEP environment is obtained for DDQN-ResNet. In addition, to identify the construction value of lines, an agent is establish based on DDQN-ResNet. Finally, we perform the static planning and visualize the reinforcement learning process. The dynamic planning is realized by reusing the training experience. The validity and flexibility of DDQN-ResNet are verified on RTS 24-bus test system.

Planning and Expansion of the Transmission Network in the Presence of Wind Power Plants

“…The planning and operation modeling in the power grids with maximizing reliability is studied in [13]. The article in [14] presents an economic approach to power flow analysis, taking into account factors such as fuel costs in power plants and the operation of units during peak demand. Meanwhile, [15] models power flow with a focus on the cost of transmission lines and incorporates the use of Flexible AC Transmission Systems (FACTS) to enhance voltage index.…”

Research on Automatic Intelligent Coloring of Animation Sketch Based on Enhanced Deep Learning

“…e new residual module Swish Gated Block proposed in this paper improves the residual module in ResNet [12][13][14]. e Swish Gated Block is composed of Swish module and residual, Swish module contains a convolutional layer and Swish activation function.…”

“…Scientific Programming [13]. e perceptual loss is calculated based on the feature map and expressed as follows:…”

Simulation test of centrifugal differential corn seed directional seeding device

“…The premise of directional seeding is directional seeding. In order to achieve directional seeding, scholars oriented seeds by seed belt [5], adsorption [6], vibration [7], image recognition and mechanism combination [8], but there are certain requirements on the working conditions in the process of seed orientation. In this paper, based on the research of corn seed mechanized directional seeding device, a directional seeding device based on centrifugal filling, differential directional deflection and diversion ring seeding is proposed, which provides a new thinking for the design of corn seed directional seeding device.…”