Gamasutra

Download the Advance Program • Register by Friday, 7 July. Final opportunity for savings. 

Video for Virtual Reality

Renderosity

FMX Conference

Courses

Video for Virtual Reality

Thursday, 3 August, 9:00 am - 12:15 pm, Los Angeles Convention Center, Room 403AB

Video captures the dynamic appearance of the real world, while virtual reality technology enables display of dynamic visual content with unparalleled realism and immersion. The fusion of video and virtual reality promises to enable many exciting photorealistic experiences. This course provides an overview of three aspects of this promising fusion: technical foundations, current systems in practice, and the potential for future systems of VR video.

The course begins with a review of the the geometric and optical problems underpinning VR video. Then it introduces 360-degree and stereoscopic video, and explains how 360 video is captured, analysed, and stitched, including the mathematics behind how state-of-the-art stereo 360 video is produced from camera systems and computational processing. It also discusses the art of storytelling in VR, and how new tools for editing VR video can aid in production. The final section focuses on the next generation of video for VR, which is moving to 6-degrees-of-freedom experiences. Topics include the basic principles and challenges of light-field cameras, how they can enable 6DoF experiences, and how light-field camera arrays have been used to create cutting-edge experiences that integrate volumetric live-action elements.

Level

Intermediate

Prerequisites

Basic knowledge of video processing, computer graphics, and computer vision is useful, but other attendees will find the course engaging. The section on storytelling and tools, for example, will be accessible to all audiences.

Intended Audience

Visual computing researchers, video producers, enthusiastic video users.

Instructor(s)

Christian Richardt
University of Bath

James Tompkin
Brown University

Jordan Halsey
VR Playhouse

Aaron Hertzmann
Adobe Systems Incorporated

Jonathan Starck
Foundry

Oliver Wang
Adobe Systems Incorporated