Markov Algorithm Online