Ray prioritization using stylization and visual saliency

Steinberger M, Kainz B, Hauswiesner S, Khlebnikov R, Kalkofen D, Schmalstieg D (2012)


Publication Type: Journal article

Publication year: 2012

Journal

Book Volume: 36

Pages Range: 673-684

Journal Issue: 6

DOI: 10.1016/j.cag.2012.03.037

Abstract

This paper presents a new method to control scene sampling in complex ray-based rendering environments. It proposes to constrain image sampling density with a combination of object features, which are known to be well perceived by the human visual system, and image space saliency, which captures effects that are not based on the objects geometry. The presented method uses Non-Photorealistic Rendering techniques for the object space feature evaluation and combines the image space saliency calculations with image warping to infer quality hints from previously generated frames. In order to map different feature types to sampling densities, we also present an evaluation of the object space and image space features impact on the resulting image quality. In addition, we present an efficient, adaptively aligned fractal pattern that is used to reconstruct the image from sparse sampling data. Furthermore, this paper presents an algorithm which uses our method in order to guarantee a desired minimal frame rate. Our scheduling algorithm maximizes the utilization of each given time slice by rendering features in the order of visual importance values until a time constraint is reached. We demonstrate how our method can be used to boost or stabilize the rendering time in complex ray-based image generation consisting of geometric as well as volumetric data. © 2012 Elsevier Ltd.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Steinberger, M., Kainz, B., Hauswiesner, S., Khlebnikov, R., Kalkofen, D., & Schmalstieg, D. (2012). Ray prioritization using stylization and visual saliency. Computers & Graphics, 36(6), 673-684. https://dx.doi.org/10.1016/j.cag.2012.03.037

MLA:

Steinberger, Markus, et al. "Ray prioritization using stylization and visual saliency." Computers & Graphics 36.6 (2012): 673-684.

BibTeX: Download