A new approach to nonlinear groundwater management methodology is presented which optimizes aquifer remediation with the aid of artificial neural networks (ANNs). The methodology allows solute transport simulations, usually the main computational component of management models, to be run in parallel. The ANN technology, inspired by neurobiological theories of massive interconnection and parallelism, has been successfully applied to a variety of optimization problems. In this new approach, optimal management solutions are found by (1) first training an ANN to predict the outcome of the flow and transport code, and (2) then using the trained ANN to search through many pumping realizations to find an optimal one for successful remediation. The behavior of complex groundwater scenarios with spatially variable transport parameters and multiple contaminant plumes is simulated with a two‐dimensional hybrid finite‐difference/finite‐element flow and transport code. The flow and transport code develops the set of examples upon which the network is trained. The input of the ANN characterizes the different realizations of pumping, with each input indicating the pumping level of a well. The output is capable of characterizing the objectives and constraints of the optimization, such as attainment of regulatory goals, value of cost functions and cleanup time, and mass of contaminant removal. The supervised learning algorithm of back propagation was used to train the network. The conjugate gradient method and weight elimination procedures are used to speed convergence and improve performance, respectively. Once trained, the ANN begins a search through various realizations of pumping patterns to determine whether or not they will be successful. The search is directed by a simple genetic algorithm. The resulting management solutions are consistent with those resulting from a more conventional optimization technique, which combines solute transport modeling and nonlinear programming with a quasi‐Newton search. The results suggest that the ANN approach has the following advantages over the conventional technique for the test remediations: more independence of the flow and transport code from the optimization, greater influence of hydrogeologic insight, and less computational burden due to the potential for parallel processing of the flow and transport simulations and the ability to “recycle” these simulations. The ANN performance was observed upon variation of the problem formulation, network architecture, and learning algorithm.
In many applications, the number of interconnects or weights in a neural network is so large that the learning time for the conventional backpropagation algorithm can become excessively long. Numerical optimization theory offers a rich and robust set of techniques which can be applied to neural networks to improve learning rates. In particular, the conjugate gradient method is easily adapted to the backpropagation learning problem. This paper describes the conjugate gradient method, its application to the backpropagation learning problem and presents results of numerical tests which compare conventional backpropagation, steepest descent and the conjugate gradient methods. For the parity problem, we find that the conjugate gradient method is an order of magnitude faster than conventional backpropagation with momentum.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.