Limiting Distributions of a Non-Homogeneous Markov System in a Stochastic Environment in Continuous Time

Abstract

The stochastic process non-homogeneous Markov system in a stochastic environment in continuous time (S-NHMSC) is introduced in the present paper. The ordinary non-homogeneous Markov process is a very special case of an S-NHMSC. I studied the expected population structure of the S-NHMSC, the first central classical problem of finding the conditions under which the asymptotic behavior of the expected population structure exists and the second central problem of finding which expected relative population structures are possible limiting ones, provided that the limiting vector of input probabilities into the population is controlled. Finally, the rate of convergence was studied.

A Continuous-Time Semi-Markov System Governed by Stepwise Transitions

“…Another important development is represented by extending the model to open systems where several individuals are considered. This would bring to a generalization of the so-called Markov/semi-Markov systems which have found a large body of literature (see, e.g., [29,30] and the reference therein).…”

Preface to the Special Issue on Probability and Stochastic Processes with Applications to Communications, Systems and Networks

“…The paper [7] introduces a stochastic process of an inhomogeneous Markov system in a stochastic environment in continuous time (S-NHMSC). The ordinary inhomogeneous Markov process is a special case of S-NHMSC.…”