Statistical Models of Appearance

../cvpr_2006_revision1.pdf Statistical Models of Appearance

$next$ $up$ $previous$
Next: The Correspondence Problem Up: Background Previous: Background

Statistical Models of Appearance

Statistical models of shape and appearance (combined appearance models) were introduced by Cootes, Edwards, Lanitis and Taylor [1,2], and have since been applied extensively (eg [14,11,10]). The construction of an appearance model depends on establishing a dense correspondence across a training set of images using a set of landmark points marked consistently on each training image.

Using the notation of Cootes [2], the shape (configuration of landmark points) can be represented as a vector $\mathbf{x}$ and the texture (intensity values) represented as a vector $\mathbf{g}$ .

The shape and texture are controlled by statistical models of the form

$\begin{displaymath}\begin{array}{cc} \mathbf{x}=\mathbf{\overline{x}}+\mathbf{P}... ...}=\overline{\mathbf{g}}+\mathbf{P}_{g}\mathbf{b}_{g}\end{array}\end{displaymath}$

(1)

Where $\mathbf{b}_{s}$ are shape parameters, $\mathbf{b}_{g}$ are texture parameters, $\mathbf{\overline{x}}$ and $\overline{\mathbf{g}}$ are the mean shape and texture, and $\mathbf{P}_{s}$ and $\mathbf{P}_{g}$ are the principal modes of shape and texture variation respectively.

Since shape and texture are often correlated, this can be taken into account in a combined statistical model of the form

$\begin{displaymath}\begin{array}{cc} \mathbf{x}=\bar{\mathbf{x}}+\mathbf{Q}_{s}\... ...\mathbf{g}=\mathbf{\bar{g}}+\mathbf{Q}_{g}\mathbf{c}\end{array}\end{displaymath}$

(2)

where the model parameters $\mathbf{c}$ control the shape and texture simultaneously and $\mathbf{Q}_{s}$ , $\mathbf{Q}_{g}$ are matrices describing the modes of variation derived from the training set. The effect of varying one element of $\mathbf{c}$ for a model built from a set of face images is shown in Figure $[*]$ .

**Figure 1:** The effect of varying the first model parameter of a facial appearance model by $\pm 2.5$ standard deviations.
[scale=0.4]../Graphics/faces_standard.png

$next$ $up$ $previous$
Next: The Correspondence Problem Up: Background Previous: Background

Roy Schestowitz 2005-11-17