Figure 9.9 shows a simple decision network for a decision of whether the agent should take an umbrella when it goes out. The agent’s utility depends on the weather and whether it takes an umbrella. The agent does not get to observe the weather; it only observes the forecast. The forecast probabilistically depends on the weather.

As part of this network, the designer must specify the domain for each random variable and the domain for each decision variable. Suppose the random variable $W\mathit{}e\mathit{}a\mathit{}t\mathit{}h\mathit{}e\mathit{}r$ has domain $\mathrm{\{}n\mathit{}o\mathit{}r\mathit{}a\mathit{}i\mathit{}n\mathrm{,}r\mathit{}a\mathit{}i\mathit{}n\mathrm{\}}$, the random variable $F\mathit{}o\mathit{}r\mathit{}e\mathit{}c\mathit{}a\mathit{}s\mathit{}t$ has domain $\mathrm{\{}s\mathit{}u\mathit{}n\mathit{}n\mathit{}y\mathrm{,}r\mathit{}a\mathit{}i\mathit{}n\mathit{}y\mathrm{,}c\mathit{}l\mathit{}o\mathit{}u\mathit{}d\mathit{}y\mathrm{\}}$, and the decision variable $U\mathit{}m\mathit{}b\mathit{}r\mathit{}e\mathit{}l\mathit{}l\mathit{}a$ has domain $\mathrm{\{}t\mathit{}a\mathit{}k\mathit{}e\mathit{}\mathrm{\_}\mathit{}i\mathit{}t\mathrm{,}l\mathit{}e\mathit{}a\mathit{}v\mathit{}e\mathit{}\mathrm{\_}\mathit{}i\mathit{}t\mathrm{\}}$. There is no domain associated with the utility node. The designer also must specify the probability of the random variables given their parents. Suppose $P\mathit{}\mathrm{(}W\mathit{}e\mathit{}a\mathit{}t\mathit{}h\mathit{}e\mathit{}r\mathrm{)}$ is defined by

$P(Forecast\mid Weather)$ is given by

Suppose the utility function, $u\mathit{}\mathrm{(}W\mathit{}e\mathit{}a\mathit{}t\mathit{}h\mathit{}e\mathit{}r\mathrm{,}U\mathit{}m\mathit{}b\mathit{}r\mathit{}e\mathit{}l\mathit{}l\mathit{}a\mathrm{)}$, is

There is no table specified for the $U\mathit{}m\mathit{}b\mathit{}r\mathit{}e\mathit{}l\mathit{}l\mathit{}a$ decision variable. It is the task of the planner to determine which value of $U\mathit{}m\mathit{}b\mathit{}r\mathit{}e\mathit{}l\mathit{}l\mathit{}a$ to select, as a function of the forecast.

Figure 9.10 shows a decision network that represents the idealized diagnosis scenario of Example 9.12. The symptoms depend on the disease. What test to perform is decided based on the symptoms. The test result depends on the disease and the test performed. The treatment decision is based on the symptoms, the test performed, and the test result. The outcome depends on the disease and the treatment. The utility depends on the costs of the test and on the outcome.

The outcome does not depend on the test, but only on the disease and the treatment, so the test presumably does not have side effects. The treatment does not directly affect the utility; any cost of the treatment can be incorporated into the outcome. The utility needs to depend on the test unless all tests cost the same amount.

The diagnostic assistant that is deciding on the tests and the treatments never actually finds out what disease the patient has, unless the test result is definitive, which it, typically, is not.

Figure 9.11 gives a decision network that is an extension of the belief network of Figure 8.3. The agent can receive a report of people leaving a building and has to decide whether or not to call the fire department. Before calling, the agent can check for smoke, but this has some cost associated with it. The utility depends on whether it calls, whether there is a fire, and the cost associated with checking for smoke.

In this sequential decision problem, there are two decisions to be made. First, the agent must decide whether to check for smoke. The information that will be available when it makes this decision is whether there is a report of people leaving the building. Second, the agent must decide whether or not to call the fire department. When making this decision, the agent will know whether there was a report, whether it checked for smoke, and whether it can see smoke. Assume that all of the variables are binary.

The information necessary for the decision network includes the conditional probabilities of the belief network and

• •

  $P(See\mathrm{\_}smoke\mid Smoke,Check\mathrm{\_}smoke)$; how seeing smoke depends on whether the agent looks for smoke and whether there is smoke. Assume that the agent has a perfect sensor for smoke. It will see smoke if and only if it looks for smoke and there is smoke. See Exercise 9.

• •

  $u(Check\mathrm{\_}smoke,Fire,Call)$; how the utility depends on whether the agent checks for smoke, whether there is a fire, and whether the fire department is called. Figure 9.12 provides this utility information.

  $Check\mathrm{\_}smoke$	$Fire$	$Call$	$Utility$
  $yes$	$true$	$yes$	$-220$
  $yes$	$true$	$no$	$-5020$
  $yes$	$false$	$yes$	$-220$
  $yes$	$false$	$no$	$-20$
  $no$	$true$	$yes$	$-200$
  $no$	$true$	$no$	$-5000$
  $no$	$false$	$yes$	$-200$
  $no$	$false$	$no$	$0$

  This utility function expresses the cost structure that calling has a cost of 200, checking has a cost of 20, but not calling when there is a fire has a cost of 5000. The utility is the negative of the cost.