9 Planning with Uncertainty

The third edition of Artificial Intelligence: foundations of computational agents, Cambridge University Press, 2023 is now available (including full text).

9.6 Review

  • Utility is a measure of preference that combines with probability.

  • A decision network can represent a finite stage partially observable sequential decision problem in terms of features.

  • An MDP can represent an infinite stage or indefinite stage sequential decision problem in terms of states.

  • A fully observable MDP can be solved with value iteration or policy iteration.

  • A dynamic decision network allows for the representation of an MDP in terms of features.