Markov Decision Process - What is the state in the Markov Decision Process?

In a Markov decision process, the set of all real numbers is just one example of an infinite state and action space. Some processes can be reduced to those with limited state and action spaces from countably infinite ones.