Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial

Markov Decision Process - What is the Markov process in simple terms?


A Markov chain, at its most fundamental, is a non-memory requiring particular sort of stochastic process. So, rather than the preceding acts' sequence determining future actions or likelihood, the sole determinant is the current circumstance. Markov discusses this trait.