Filtering method for linear and non-linear stochastic optimal control of partially observable systems II

Abstract

In this paper we studied stochastic optimal control problem based on partially observable systems (SOCPP) with a control factor on the diffusion term. A SOCPP has state and observation processes. This kind of problem has also a minimum payoff function. The payoff function should be minimized according to the partially observable systems consist of the state and observation processes. In this regard, the filtering method is used to evaluat this kind of problem and express full consideration of it. Finally, presented estimation methods are used to simulate the solution of a partially observable system corresponding to the control factor of this problem. These methods are numerically used to solve linear and nonlinear cases.

The spectral linear filter method for a stochastic optimal control problem of partially observable systems

“…In this case, the optimal control function is in the drift coefficient of the state process. In our other work, we used the filtering method (for a more complex form) to solve this kind of problem. In this case, the control function is in the diffusion coefficient of the state process.…”