Time periodic optimal policy for operation of a water storage tank using the dynamic programming approach

Abstract

Operation of a water storage tank in a specific environment motivates mathematical studies on a discrete-time deterministic dynamic programming problem. The operator decides whether or not to open the valve releasing the water in the tank to a drip irrigation system, based on the information on the storage volume of the tank. Two cases of functional regularity, which are Lipschitz continuous and of bounded variations, are considered for the reward defining the performance index to be maximized. Firstly, it is shown that the value function inherits the Lipschitz continuity of the reward in the infinite time horizon problem with discounting. Then, time periodic value functions are discussed in terms of the fixedpoint theorem. Discrete approximation of value functions is discussed as well, to conduct numerical experiments with a-posteriori error estimation applied to the real-world problem where the discount rate approaches to unity. It is found that a Skiba point appears as a threshold of valve opening for each day in an optimal policy for operation. Practically, setting a constant threshold throughout the period is quite reasonable and acceptable for the operator of the water storage tank to irrigate the farmland.

Level-set methods applied to the kinematic wave equation governing surface water flows

“…, , k t i x j z ϕ ∆ ∆ ∆ for , , k i j ∈  . The characteristic method analogous to the one solving a Bellman equation in dynamic programming is employed (Unami et al, 2019). The piecewise linear interpolation is applied to the x-direction as…”

Bounding linear rainfall-runoff models with fractional derivatives applied to a barren catchment of the Jordan Rift Valley

“…A Self-archived copy in Kyoto University Research Information Repository https://repository.kulib.kyoto-u.ac.jp E and E  when dealing with time series in broader sense (Unami et al, 2019). The index NSE is the Nash-Sutcliffe Efficiency coefficient, which is the most utilized index in hydrological applications involving correlations between observed and estimated values (Biondi et al, 2012).…”

Identification of nominal release policies implemented in a multi-purpose water reservoir

“…Stochastic dynamic programming (SDP) theory is the general framework to establish reservoir operation policies, as explored decades ago (Heidari et al 1971;Tejada-Guibert et al 1993, 1995Yakowitz 1982). The SDP typically provides optimal operation policies with thresholds of opening valves or switching pumps (Nop et al 2021;Unami, Mohawesh 2018;Unami et al 2019b). However, reservoir operators generally do not accept such theoretically generated policies but instead rely on their empirical knowledge to make decisions when unexpected risks are involved (El-Shafie et al 2014).…”