PhD student Tobias Bertel presents at IEEE VR 2019
Today our PhD student Tobias Bertel is presenting his work with Dr Neill Campbell and Dr Christian Richardt at IEEE VR 2019. The IEEE Virtual Reality conference is the premier international venue for the presentation of research results in the broad area of virtual reality (VR).
The ubiquity of smart mobile devices, such as phones and tablets, enables users to casually capture 360° panoramas with a single camera sweep to share and relive experiences. However, panoramas lack motion parallax as they do not provide different views for different viewpoints. The motion parallax induced by translational head motion is a crucial depth cue in daily life. Alternatives, such as omnidirectional stereo panoramas, provide different views for each eye (binocular disparity), but they also lack motion parallax as the left and right eye panoramas are stitched statically. Methods based on explicit scene geometry reconstruct textured 3D geometry, which provides motion parallax, but suffers from visible reconstruction artefacts. The core of our method is a novel multi-perspective panorama representation, which can be casually captured and rendered with motion parallax for each eye on the fly. This provides a more realistic perception of panoramic environments which is particularly useful for virtual reality applications. Our approach uses a single consumer video camera to acquire 200–400 views of a real 360° environment with a single sweep. By using novel-view synthesis with flow-based blending, we show how to turn these input views into an enriched 360° panoramic experience that can be explored in real time, without relying on potentially unreliable reconstruction of scene geometry. We compare our results with existing omnidirectional stereo and image-based rendering methods to demonstrate the benefit of our approach, which is the first to enable casual consumers to capture and view high-quality 360° panoramas with motion parallax.
You can read more on the project website here.
Bertel, T., Campbell, N., & Richardt, C. (2019). MegaParallax: Casual 360° Panoramas with Motion Parallax. IEEE Transactions on Visualization and Computer Graphics. https://doi.org/10.1109/TVCG.2019.2898799