Paul Debevec, VES
Chief Research Officer, Eyeline Studios
Governor, Visual Effects, Academy of Motion Pictures
Adjunct Research Professor, USC CS
USC
ICT
/www.debevec.org
Bio | Films | Talks | Publications | Resources | News Clippings

* Research Contributions *

Welcome! This site presents most of the work I have been involved with in computer graphics, including research papers, computer animations, art projects, software, and educational resources.

Recent Events:
2022
2/3Talk at HPA Tech Retreat, Palm Springs
5/3Talk at FMX, Stuttgart
7/6Opening Keynote at Mundos Digitales, A Coruna
8/2Podcast for CGPro
10/20Talk at VIEW, Turin
11/8Panel at RealTime Conference
2023
TBAVirtual Production Podcast
Corridor Crew Interview & Sodium Vapor Video
 

High Res Videos: The Campanile Movie | Rendering with Natural Light | Fiat Lux | Light Stage 1 | The Parthenon
2022 Lifetime Achievement Emmy Award
  Materials
Announcement/Citation | Writeup | Emmy ceremony photos | Full ceremony | Awards host serenade | Acceptance remarks

Articles
Hollywood Reporter | Michigan Engineering | Daily Cal | Berkeley Engineering | USC ICT | FXGuide
Research at Netflix & Eyeline Studios 2021-


DifFRelight Diffusion-Based Facial Performance Relighting
SIGGRAPH Asia 2024


Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization
DigiPro 2023


Recreating the Sodium Vapor Matting Process
SIGGRAPH 2024 Posters


Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization
DigiPro 2023


Jointly Optimizing Color Rendition and In-Camera Backgrounds in an RGB Virtual Production Stage
DigiPro 2022


HDR Lighting Dilation for Dynamic Range Reduction on Virtual Production Stages
SIGGRAPH 2022 Posters
Research at Google Daydream 2016-2021


Project Starline
SIGGRAPH 2024 ETech


NeRFactor: Neural Factorization of Shape and Reflectance Under Unknown Illumination
SIGGRAPH Asia 2021


Total Relighting: Learning to Relight Portraits for Background Replacement
SIGGRAPH 2021


Baking Neural Radiance Fields for Real-Time View Synthesis
ICCV 2021


Neural Light Transport for Relighting and View Synthesis
ACM TOG 2021


The Phenomenon of Eclipsed Bokeh
SIGGRAPH 2020 Posters


Light Stage Super-Resolution: Continuous High-Frequency Relighting
SIGGRAPH Asia 2020


Deep Relightable Textures: Volumetric Performance Capture with Neural Rendering
SIGGRAPH Asia 2020


Learning Illumination from Diverse Portraits
SIGGRAPH Asia 2020
Technical Communications



Immersive Light Field Video with a Layered Mesh Representation
SIGGRAPH 2020


The Relightables Volumetric Performance Capture
SIGGRAPH Asia 2019


Low Cost Panoramic Light Field Video
SIGGRAPH Asia 2019 Posters


Single Image Portrait Relighting
SIGGRAPH 2019


Deep Facial Reflectance Fields from Color Gradient Illumination
SIGGRAPH 2019


Compositing Light Field Video Using Multiplane Images
SIGGRAPH 2019 Posters


DeepView: View Synthesis with Learned Gradient Descent
CVPR 2019


DeepLight: Learning Illumination for Mobile Mixed Reality
CVPR 2019


Acquiring and Rendering Panoramic Light Field Stills for Virtual Reality
SIGGRAPH Asia 2018
Favorite Projects


3D Scanning the President of the United States
White House Maker Faire
2014


The Light Stages at UC Berkeley and USC ICT
2010 Academy Awards
SIGGRAPH Asia 2012
2019 Academy Awards


Digital Emily:
Achieving a Photoreal Digital Actor

SIGGRAPH 2008 Expo
CVMP 2009
IEEE CG&A 2010


Digital Ira: Creating a Real-Time Photoreal Digital Actor
SIGGRAPH 2013
Real-Time Live


Rendering for an
(Award Winning!)
Interactive 360º Light Field Display

SIGGRAPH 2007


Achieving Eye Contact in Live 3D Teleconferencing
SIGGRAPH 2009
Tutorials, Software, and Datasets


High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting, 2ed.
Morgan Kaufmann 2010


Virtual Cinematography: Relighting Through Computation
IEEE Computer Aug 2006


HDR Shop:
High Dynamic Range Image Processing and Manipulation


Light Probe Image Gallery

Released
SIGGRAPH 99


High-Res Light Probe Gallery
Released
SIGGRAPH 2006


Light Stage Data Gallery
Released
SIGGRAPH 2006
Films
(YouTube Playlist)


The Campanile Movie
SIGGRAPH 97
Electronic Theater


Rendering with Natural Light

SIGGRAPH 98
Electronic Theater


Fiat Lux
SIGGRAPH 99
Electronic Theater


Image-Based Lighting
SIGGRAPH 2000
Electronic Theater


The Parthenon
SIGGRAPH 2004
Electronic Theater


Welcome to Light Fields
Steam VR &
SIGGRAPH 2018 Immersive Pavillion

Graphics Research at USC ICT 2000-2016


Practical Multispectral Lighting Reproduction
SIGGRAPH 2016


Driving High-Resolution Facial Scans with Video Performance Capture
ACM TOG 2014


Skin Microstructure Deformation with Displacement Map Convolution
SIGGRAPH 2015


Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
SIGGRAPH 2015 ETech
CVPR WCCD 2016


Acquiring Reflectance and Shape from SH Illumination
SIGGRAPH 2013


Measurement-Based Synthesis of Facial Microgeometry
Eurographics 2013


DeepView: View Synthesis with Learned Gradient Descent
CVPR 2019


Deep Light: DeepLight Learning Illumination for Unconstrained Mobile Mixed Reality
CVPR 2019


FlashMob: Near-Instant Capture of High-Resolution Facial Geometry and Reflectance
Eurographics 2016


A Single-Shot Light Probe
SIGGRAPH 2012 Talks


An Autostereoscopic Projector Array Optimized for 3D Facial Display
SIGGRAPH 2013
E-Tech


Geometry-Corrected Light Field Rendering for Creating a Holographic Stereogram
IEEE CVPRW 2012


Multiview Face Capture using Polarized Spherical Gradient Illumination
SIGGRAPH Asia 2011


Practical Image-Based Relighting and Editing with Spherical-Harmonics and Local Lights
CVMP 2011


Facial Cartography: Interactive High-Resolution Scan Correspondence
SCA 2011


Prototyping a Light Field Display Involving Direct Observation of a Video Projector Array
PROCAMS 2011
Best Paper Award


Comprehensive Facial Performance Capture
Eurographics 2011


Circularly Polarized Spherical Illumination Reflectometry
SIGGRAPH Asia 2010


Dynamic Shape Capture using Multi-View Photometric Stereo
SIGGRAPH Asia 2009


Estimating Specular Roughness and Anisotropy from Second Order Spherical Gradient Illumination
EGSR 2009


Separation of Diffuse and Specular Reflections using Environmental Illumination
ICCP 2009


Compressive Light Transport Sensing
ACM TOG 2009


Practical Modeling and Acquisition of Layered Facial Reflectance
SIGGRAPH Asia 2008


Facial Performance Synthesis using Polynomial Displacement Maps
SIGGRAPH Asia 2008


A Framework for Capture and Synthesis of High Resolution Facial Geometry and Performance
NTU PhD Thesis, 2008


Viewfinder: How to Seamlessly "Flickrize" Google Earth
2008


Real-time Geometry and Reflectance Capture for Digital Face Replacement
ICT-TR-04-2008


Postproduction Facial Performance Relighting Using Reflectance Transfer
SIGGRAPH 2007


Rendering for an Interactive 360º Light Field Display
SIGGRAPH 2007


Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination
EGSR2007


Relighting Human Locomotion with Flowed Reflectance Fields
EGSR 2006
SIGGRAPH 2006 CAF


Efficient Estimation of Spatially-Varying SSS Parameters
Live Capture Now Online!
VMV 2006


Concave Surround Optics for Rapid Multiview Imaging
ASC 2006
SIGGRAPH 2006 Poster


A Reflective Light Stage
ICT-TR-04.2006


Simulating Spatially Varying Lighting on a Live Performance
CVMP 2006
SIGGRAPH 2005 Sketch


A Median Cut Algorithm for Light Probe Sampling
SIGGRAPH 2005 Poster


Performance Relighting with Time-Multiplexed Illumination
SIGGRAPH 2005


Acquisition of Time-Varying Participating Media
SIGGRAPH 2005


A Dual Light Stage
EGSR 2005


Direct HDR Capture of the Sun and Sky
AFRIGRAPH 2004


Estimating Reflectance Properties under Natural Illumination
ICT-TR-06-2004


Animatable Facial Reflectance Fields
EGSR 2004


Real-time High Dynamic Range Texture Mapping

EGWR 2001


A Photometric Approach to Digitizing Cultural Artifacts

VAST 2001


A Lighting Reproduction
Approach to Live-Action Compositing

SIGGRAPH 2002


Capturing and Rendering with Incident Light Fields
EGSR 2003


Optimizing Color Matching in a Lighting Reproduction System
EGSR 2003


Linear Light Source Reflectometry
SIGGRAPH 2003
Graphics Research at UC Berkeley 1996-2000


Modeling and Rendering Architecture from Photographs

SIGGRAPH 96

ACM Seminal Graphics Paper


Recovering High Dynamic Range Radiance Maps from Photographs

SIGGRAPH 97

ACM Seminal Graphics Paper


Efficient View-Dependent IBR with Projective Texture-Mapping

EGRW 98


Rendering Synthetic Objects into Real Scenes

SIGGRAPH 98


Inverse Global Illumination

SIGGRAPH 99


Acquiring the Reflectance Field of a Human Face

[+Demo!]
SIGGRAPH 2000

ACM Seminal Graphics Paper
complete list of publications
Additional Online Resources


SIGGRAPH 2007 Computer Animation Festival


SIGGRAPH 98-2000 Course on Image-Based Modeling, Rendering, and Lighting


The Story of Reflection Mapping


SIGGRAPH 2003 Course on Image-Based Lighting


The Parthenon
Sculpture Gallery
Early Image-Based Projects


The Chevette Project

1991


Facial Feature Recognition with Neural Networks

1992


Immersion '94

1994


Rouen Revisited

SIGGRAPH 96 Art Gallery


St. Paul's Cross

1997
Miscellany


Chaotic Dynamic Simulation of Free-Throw Space

1992


Knee Visualization from MR Images

1993


3D Drawing in Microsoft Office

1992-1995


Pinhole Photography with a Regular Camera

1997
More Pictures and Movies
Bio | Films | Publication List | Resources | Press Clippings