12.7 Review

  • Utility is a measure of preference that combines with probability.

  • A decision network can represent a finite-stage, partially observable sequential decision problem in terms of features.

  • An MDP can represent an infinite-stage or indefinite-stage sequential decision problem in terms of states.

  • A fully observable MDP can be solved with value iteration or policy iteration.

  • A dynamic decision network allows for the representation of an MDP in terms of features.

  • Utility-based decision making in the public realm can be made more transparent and accountable if the utility measures are made explicit.