Partially Observable Markov Decision Process - What is a semi Markov Decision Process?

A semi-Markov process is a type of stochastic process that, when it enters state i, uses the waiting time density function w i (τ) to randomly decide the waiting period τ for transitioning out of state i. After that, using the probabilities of state transitions, it chooses the next state to be in at random, j.