“…The establishment of Markov chain from the branch of probability theory by A. Markov was developed in 1913 by applying in poetry (Hayes, 2013). Later, so many applications of Markov chain (Von Hilgers and Langville, 2006) appeared such as forecasting variables of economics such as poverty, inflation, employment (Waller et al, 2019), supply chain management (Yin et al, 2010), optimization (Cao, 2015a(Cao, , 2015bCao, 2009), molecular reaction (Salehi et al, 2015), passphrase cracking (Sparell and Simovits, 2016), image segmentation (Boudaren and Monfrini and W Pieczynski, 2012) and execution examination of wireless communications (Liu et al, 2017), to say a few. The study on classification of Markov chain as homogeneous and non-homogeneous is also experienced (Cao, 2015a(Cao, , 2015bWan et al, 2016).…”