6.3 Regression Planning

Dimensions: flat, features, indefinite horizon, fully observable, deterministic, goal directed, non-learning, single agent, offline, perfect rationality

It is often more efficient to search in a different search space – one where the nodes are not states but rather are subgoals to be achieved. A subgoal is an assignment to some of the features.

Regression planning is searching in the graph defined by the following:

•

The nodes are subgoals.
•
The arcs correspond to actions. In particular, an arc from node $g$ to $g^{\prime}$ , labeled with action $a c t$ , means
- –
  
  $a c t$ is the last action that is carried out before subgoal $g$ is achieved, and
- –
  
  node $g^{\prime}$ is a subgoal that must be true immediately before $a c t$ so that $g$ is true immediately after $a c t$ .
•

The start node is the planning goal to be achieved.
•

The goal condition for the search, $goal(g)$ , is true if $g$ is true of the initial state.

Given a node that represents subgoal $g$ , a neighbor of $g$ exists for every action $a c t$ such that

•

$a c t$ is possible, it is possible for $a c t$ to be carried out and for $g$ to be true immediately after $a c t$ and
•

$a c t$ is useful, $a c t$ achieves part of $g$ .

Consider the subgoal $g=\{X_{1}{=}v_{1},\dots,X_{n}{=}v_{n}\}$ . In terms of the STRIPS representation, $a c t$ is useful for solving $g$ if, for some $i$ , $X_{i}{=}v_{i}$ is an effect of action $a c t$ . Immediately before $a c t$ , the preconditions of $a c t$ , as well as any $X_{k}{=}v_{k}$ not achieved by $a c t$ , must hold. Thus the neighbor of subgoal $g$ on the arc labeled with $a c t$ is the subgoal $precondition(act)\cup(g\setminus effects(act))$ , as long as $a c t$ is possible. Action $a c t$ is possible if:

•

for each $X_{j}{=}v_{j}$ in $g$ , there is no effect $X_{j}{=}v_{j}$ of $a c t$ where $v_{j}^{\prime}\neq v_{j}$ and
•

$precondition(act)\cup(g\setminus effects(act))$ does not include two different assignments to any feature.

Example 6.11.

Suppose the goal is to achieve $\neg{swc}$ . Therefore, the start node is $\{\neg{swc}\}$ . If this is true in the initial state, the planner stops. If not, it chooses an action that achieves $\neg{swc}$ . In this case, there is only one such action: $d c$ . The precondition of $d c$ is $\{off,rhc\}$ . Thus, there is one arc:

\left<\{\neg{swc}\},\{off,rhc\}\right>\mbox{ labeled with }dc.

Consider the node $\{off,rhc\}$ . There are two actions that can achieve $o f f$ , namely $m c$ from $c s$ and $m c c$ from $l a b$ . There is one action that can achieve $r h c$ , namely $p u c$ . However, $p u c$ has as precondition $\{cs,\neg{rhc}\}$ , but $c s$ and $o f f$ are inconsistent (because they involve different assignments to the variable $R L o c$ ). Therefore, $p u c$ is not a possible last action; it is not possible that, immediately after $p u c$ , the condition $\{off,rhc\}$ holds.

Figure 6.3: Part of the search space for a regression planner

Figure 6.3 shows the first three levels of the search space (without cycle pruning or multiple-path pruning). Note that the search space is the same no matter what the initial state is. The starting state has two roles: to serve as a stopping criterion and as a source of heuristics.

If a subgoal contains a number of assignments, regression can often determine which of the assignments to achieve last, as in the following example.

Example 6.12.

Suppose the goal is for Sam to not want coffee and for the robot to have coffee: $\{\neg{swc},rhc\}$ . The last action cannot be $d c$ to achieve $\neg{swc}$ , because this achieves $\neg{rhc}$ . The only last action must be $p u c$ to achieve $r h c$ . Thus, the resulting subgoal is $\{\neg{swc},cs\}$ . Again, the last action before this subgoal cannot be to achieve $\neg{swc}$ because this has as a precondition $o f f$ , which is inconsistent with $c s$ . Therefore, the second-to-last action must be a move action to achieve $c s$ .

In terms of the feature-based representation of actions, an action $a c t$ is useful if there is a causal rule that achieves $X_{i}{=}v_{i}$ for some $i$ , using action $a c t$ . The neighbor of this node along the arc labeled with action $a c t$ is the proposition

precondition(act)\wedge body(X_{1}{=}v_{1},act)\wedge\dots\wedge body(X_{n}{=}% v_{n},act)

where $body(X_{i}{=}v_{i},act)$ is the set of assignments of variables in the body of a rule that specifies when $X_{i}{=}v_{i}$ is true immediately after $a c t$ . There is no such neighbor if there is no corresponding rule for some $i$ , or if the proposition is inconsistent (i.e., assigns different values to a variable). Note that, if multiple rules are applicable for the same action, there will be multiple neighbors.

Search algorithms such as $A^{*}$ and branch-and-bound can make use of heuristic knowledge. For a regression planner, the heuristic value of a node is an estimate of the cost to achieve the subgoal represented by the node from the initial state. This form of heuristic as an estimate of the cost of achieving a subgoal from a state is the same as used in a forward planner. So, for example, the heuristic of Example 6.10 could also be used for a regression planner. However, an effective heuristic for a regression planner may not be very useful for a forward planner, and vice versa (see Exercise 4).

One problem that arises in regression planning is that a subgoal may not be achievable. Deciding whether a subgoal is achievable is often difficult to infer from the definitions of the actions. For example, consider the restriction that an object cannot be at two different places at the same time; sometimes this is not explicitly represented and is only implicit in the effects of an action, and the fact that the object is only in one position initially. It is possible to have domain knowledge to prune nodes that can be shown to be inconsistent.

Cycle pruning and multiple-path pruning may be incorporated into a regression planner. The regression planner does not have to visit exactly the same node to prune the search. If the subgoal represented by a node $n$ is a superset of a subgoal on the path to $n$ , node $n$ can be pruned. Similarly, for multiple-path pruning, see Exercise 10.

A regression planner commits to a total ordering of actions, even if no particular reason exists for one ordering over another. This commitment to a total ordering tends to increase the complexity of the search space if the actions do not interact much or at all. For example, a regression planner would test each permutation of a sequence of actions when it may be possible to show that no ordering can succeed.

Artificial Intelligence 2E

6.3 Regression Planning

Example 6.11.

Example 6.12.

Artificial
Intelligence 2E