Entertainment / Evénementiel
High-tech / IT
Industry

Company

Fraunhofer IIS

The Fraunhofer Institute for Integrated Circuits IIS, headquartered in Erlangen, Germany, conducts world-class research on microelectronic research and IT system solutions and services. Today, it is the largest institute of the Fraunhofer-Gesellschaft. For over 30 years, the institute’s Audio and Media Tech-nologies division has been shaping the globally de-ployed standards and technologies in the fields of audio and moving picture production.

Solution

ToHyVe - Photorealistic presentation and Social Stage VR - Bringing stage events with real actors to your home in VR

The neural 3D reconstruction and rendering pipeline developed at Fraunhofer IIS can be used to digitize complex objects, including their viewing angle-dependent effects. The model can then be rendered in real time in a game engine or a web browser. We demonstrate a novel method how to integrate stereo content of a live act into a virtual reality (VR) environment. This opens a new level of immersion, when watching the recording of a stage event using a head mounted display.


Watch video