11 Beyond Supervised Learning

Learning without thought is labor lost; thought without learning is perilous.

Confucius (551 BC - 479 BC), The Confucian Analects

This chapter goes beyond the supervised learning of Chapter 7. It covers learning richer representation and learning what to do; this enables learning to be combined with reasoning. First we consider unsupervised learning in which the classifications are not given in the training set. This is a special case of learning belief network, which is considered next. Finally, we consider reinforcement learning, in which an agent learns how to act while interacting with an environment.