A n×n matrix is called a Markov matrix if all entries are nonnegative and the sum of each column vectoris equal to 1.

After calculating the eigenvector and eigenvalue,

Leading to projection on the orthonormal basis, that is Fourie serie

For example