../cvpr_2006_revision1.pdf Statistical Models of Appearance
PDF version of this document

next up previous
Next: The Correspondence Problem Up: Background Previous: Background

Statistical Models of Appearance

Statistical models of shape and appearance (combined appearance models) were introduced by Cootes, Edwards, Lanitis and Taylor [1,2], and have since been applied extensively (eg [14,11,10]). The construction of an appearance model depends on establishing a dense correspondence across a training set of images using a set of landmark points marked consistently on each training image.

Using the notation of Cootes [2], the shape (configuration of landmark points) can be represented as a vector $ \mathbf{x}$ and the texture (intensity values) represented as a vector $ \mathbf{g}$.

The shape and texture are controlled by statistical models of the form

\begin{displaymath}\begin{array}{cc} \mathbf{x}=\mathbf{\overline{x}}+\mathbf{P}...
...}=\overline{\mathbf{g}}+\mathbf{P}_{g}\mathbf{b}_{g}\end{array}\end{displaymath} (1)

Where $ \mathbf{b}_{s}$ are shape parameters, $ \mathbf{b}_{g}$ are texture parameters, $ \mathbf{\overline{x}}$ and $ \overline{\mathbf{g}}$ are the mean shape and texture, and $ \mathbf{P}_{s}$ and $ \mathbf{P}_{g}$ are the principal modes of shape and texture variation respectively.

Since shape and texture are often correlated, this can be taken into account in a combined statistical model of the form

\begin{displaymath}\begin{array}{cc} \mathbf{x}=\bar{\mathbf{x}}+\mathbf{Q}_{s}\...
...\mathbf{g}=\mathbf{\bar{g}}+\mathbf{Q}_{g}\mathbf{c}\end{array}\end{displaymath} (2)

where the model parameters $ \mathbf{c}$ control the shape and texture simultaneously and $ \mathbf{Q}_{s}$, $ \mathbf{Q}_{g}$ are matrices describing the modes of variation derived from the training set. The effect of varying one element of $ \mathbf{c}$ for a model built from a set of face images is shown in Figure [*].

Figure 1: The effect of varying the first model parameter of a facial appearance model by $ \pm 2.5$ standard deviations.
[scale=0.4]../Graphics/faces_standard.png


next up previous
Next: The Correspondence Problem Up: Background Previous: Background
Roy Schestowitz 2005-11-17