While the rig runs, the cameras record an image of
the person under every possible direction of illumination. We can
recombine this set of images to generate a rendering of what the
person would look like under any complex form of illumination - where
light comes from every direction with different colors. Most
importantly, this includes illumination that we have sampled from the
real world using the light probe lighting capture technique. Below
are five images of a subject's face illuminated with light from
different environments:
The environments are, left to right, St. Peter's
Basilica, the UC Berkeley Eucalyptus Grove, The Uffizi Gallery in
Florence, Grace Cathedral in San Francisco, and a synthetic test
environment. These lighting environments are available in the Light Probe Image
Gallery. Below each face rendering is the lighting environment
resampled to the same resolution as the Light Stage lighting direction
data at 64 × 32 pixels.
In our work we also obtain a range scan of the face
which allows us to project the re-illuminated appearance onto the
geometry and render the face from arbitrary viewpoints. We use a
second view of the face from the mirrored direction to get the
information for the entire face. We use a reflectance analysis
technique to detect and re-render the specular reflection of the face
so that it is consistent with the novel viewing directions. Some of
these results are shown on page 10 of the paper below. The model
is actress Jessica
(a.k.a. De'Lila) Vallot, star of Pacific/Title Mirage's SIGGRAPH 99 and 2000
Electronic Theater hits "The Jester" and "Young at
Heart".
|