There is rapidly growing interest in the creation of rendered environments and content for virtual and augmented reality. Currently, the most popular approaches include polygonal environments created with game engines, as well as 360 degree spherical cameras used to capture live action video. These tools were not originally designed to leverage the more complex visual cues available in immersive environments when users laterally shift viewpoints, manually interact with models, and employ stereoscopic vision. There is a need for a fresh look at computer graphics techniques that can capitalize upon the unique affordances that make virtual and augmented reality so compelling. Furthermore, the manual creation of high-quality immersive content is time and labor intensive. To address these challenges, the Illusioneering Lab researches new techniques and technologies for creating lifelike immersive content through the automatic capture and digitization of real world objects, people, and behaviors.
Automatic Generation of Dynamically Relightable Virtual Objects with Consumer-Grade Depth Cameras