Markov Chains

A Markov Chain is simply a set of states and a set of probabilities describing where an entity in one state is likely to go the next step. It may help to think of the entity as you and the states as places you like to go, but this can also be applied on a […]