The MathResource
Markov chain
or Markov process, n. (Statistics) a sequence of events, usually called states, the probability of each of which is dependent only on the event immediately preceding it. (Named after the Russian probabilist, topologist, number theorist, and algebraist, Andrei Andreiëvich Markov (1856-1922), who developed the theory of stochastic processes.) See also transition matrix.