Markov Matrix

A Markov Matrix, also known as a stochastic matrix, is a probability matrix where each of its cell entry is a positive real number which represents a probability. The sum of each column of a stochastic matrix adds up to one.