Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Pomdp - How do you calculate belief states?

Answer

To calculate a belief state for a 2-horizon, just add the values of the upcoming action and the immediate one. If we want to find the maximum value, we need to think about every conceivable combination of two acts.