Time‐Warped Foveated Rendering for Virtual Reality Headsets

Franke L, Fink L, Martschinke J, Selgrad K, Stamminger M (2020)


Publication Language: English

Publication Type: Journal article

Publication year: 2020

Journal

Book Volume: 40

Pages Range: 110-123

Article Number: cgf.14176

Journal Issue: 1

URI: https://www.lgdv.tf.fau.de/?p=1980

DOI: 10.1111/cgf.14176

Abstract

Rendering in real time for virtual reality headsets with high user immersion is challenging due to strict framerate constraints as well as due to a low tolerance for artefacts. Eye tracking‐based foveated rendering presents an opportunity to strongly increase performance without loss of perceived visual quality. To this end, we propose a novel foveated rendering method for virtual reality headsets with integrated eye tracking hardware. Our method comprises recycling pixels in the periphery by spatio‐temporally reprojecting them from previous frames. Artefacts and disocclusions caused by this reprojection are detected and re‐evaluated according to a confidence value that is determined by a newly introduced formalized perception‐based metric, referred to as confidence function. The foveal region, as well as areas with low confidence values, are redrawn efficiently, as the confidence value allows for the delicate regulation of hierarchical geometry and pixel culling. Hence, the average primitive processing and shading costs are lowered dramatically. Evaluated against regular rendering as well as established foveated rendering methods, our approach shows increased performance in both cases. Furthermore, our method is not restricted to static scenes and provides an acceleration structure for post‐processing passes.

Authors with CRIS profile

How to cite

APA:

Franke, L., Fink, L., Martschinke, J., Selgrad, K., & Stamminger, M. (2020). Time‐Warped Foveated Rendering for Virtual Reality Headsets. Computer Graphics Forum, 40(1), 110-123. https://doi.org/10.1111/cgf.14176

MLA:

Franke, Linus, et al. "Time‐Warped Foveated Rendering for Virtual Reality Headsets." Computer Graphics Forum 40.1 (2020): 110-123.

BibTeX: Download