SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis

Roodaki H, Navab N, Eslami A, Stapleton C, Navab N (2017)

Publication Type: Journal article

Publication year: 2017

Journal

IEEE Transactions on Visualization and Computer Graphics Institute of Electrical and Electronics Engineers (IEEE)

Book Volume: 23

Pages Range: 2366-2371

Article Number: 8007327

Journal Issue: 11

DOI: 10.1109/TVCG.2017.2734327

Abstract

Sonic interaction as a technique for conveying information has advantages over conventional visual augmented reality methods specially when augmenting the visual field with extra information brings distraction. Sonification of knowledge extracted by applying computational methods to sensory data is a well-established concept. However, some aspects of sonic interaction design such as aesthetics, the cognitive effort required for perceiving information, and avoiding alarm fatigue are not well studied in literature. In this work, we present a sonification scheme based on employment of physical modeling sound synthesis which targets focus demanding tasks requiring extreme precision. Proposed mapping techniques are designed to require minimum training for users to adapt to and minimum mental effort to interpret the conveyed information. Two experiments are conducted to assess the feasibility of the proposed method and compare it against visual augmented reality in high precision tasks. The observed quantitative results suggest that utilizing sound patches generated by physical modeling achieve the desired goal of improving the user experience and general task performance with minimal training.

Involved external institutions

Technische Universität München (TUM) DE Germany (DE) Concordia University CA Canada (CA) Carl Zeiss Meditec AG DE Germany (DE)

How to cite

APA:

Roodaki, H., Navab, N., Eslami, A., Stapleton, C., & Navab, N. (2017). SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis. IEEE Transactions on Visualization and Computer Graphics, 23(11), 2366-2371. https://doi.org/10.1109/TVCG.2017.2734327

MLA:

Roodaki, Hessam, et al. "SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis." IEEE Transactions on Visualization and Computer Graphics 23.11 (2017): 2366-2371.

BibTeX: Download