Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial

Partially Observable Markov Decision Process - What is a semi Markov Decision Process?


A semi-Markov process is a type of stochastic process that, when it enters state i, uses the waiting time density function w i (τ) to randomly decide the waiting period τ for transitioning out of state i. After that, using the probabilities of state transitions, it chooses the next state to be in at random, j.