Sunday, July 7, 2013

Seeing Through the Lens of Markov Processes

"That's a Markov process"
What would it be like if we see the world through the lens of Markov processes?

What's a Markov process?

Two mild conditions:
  1. Finite set of states
  2. Stable transition probabilities
  3. Members can move from one state to another
Under those two conditions, the Markov Convergence Theorem says that there will be statistical equilibrium such that the number of members in each state remains the same even though there is churn.

How to determine the Markov Equilibrium?

Build the Markov Transition Matrix and solve for the equilibrium.

No comments:

Post a Comment