Daniel Fine
media | projection | system
design & integration
Elevator #7 : Live Performance in Shared Virtual Worlds
Virtual Reality & Live Performance
Haptic feedback: A user stands next to a fire in the virtual world while a space heater blows hot air on her in the real world.
A user looks down into a hole in the floor in the virtual world to see a live performer below him. Performer is on a greenscreen in the background.
Live performer on a greenscreen. Physical camera is mounted above. Videostream is on a plane below the floor in the virtual world.
A user talks to the performer.
User sees the live performer composited into the virtual world.
User talks to a live performer.
Rendering of the 3D model (built with 3Ds Max) inside Unity.
Ground plan of stage for audience experience.
8 - 8
<
>
Co-Principal Investigator, Artistic Director, Co-Creator, Digital Media & Experience Design
Role:
Outcomes/Dissemination:
December 2018:
Performance: Mabie Theatre, University of Iowa, Iowa City, IA
June 2019:
Conference Presentation: Prague Quadrennial, Czech Republic
About:
A multi-year research project of faculty and students at the University of Iowa departments of Theatre Arts, Dance, Computer Science, and Art & Art History that explores the emerging collision of live performance, 3D design, computer science, expanded cinema, and virtual worlds by creating a room-scale, mixed-reality, live experience. Members of the “audience” each wear a head-mounted display and share a virtual environment with live performers.
Objectives explored: 1.) The principles of producing live performance/VR experiences; 2.) The methods of integrating live actors into virtual worlds; 3.) Novel ways to create the scenography of real and virtual worlds, including live image streams and physical props that provide haptic feedback; 4.) Technical solutions for unleashing the possibilities of performance design within VR.
Tech Specs:
Room-scale VR and physical world experience with four live cameras, greenscreen, Unity, HTC Vive, Cinema 4D.
Creative Team:
Faculty
Joseph Kearney: co-creator, virtual reality technical director
Daniel Fine: co-creator, artistic director, live video
Alan MacVey: co-creator, writer, director
Bryon Winn: co-creator, sound design
Monica Correia: co-creator, 3-D design
Joseph Osheroff: primary performer
Students
Marc Macaranas: live video, choreography
Sarah Gutowski: 3-D modeling, texture
Xiao Song: virtual reality programmer
Ryan McElroy: sound design, sound board operator
Chelsea Regan: costume designer
Actors: Ashlynn Dale, Octavius Lanier, Chris Walbert, Shelby Zukin
Production assistants: Courtney Gaston, Nick Coso
copyright 2020