A virtual piano-playing environment for rehabilitation based upon ultrasound imaging

Castellini C, Hertkorn K, Sagardia M, González DS, Nowak M (2014)


Publication Type: Conference contribution

Publication year: 2014

Publisher: IEEE Computer Society

Pages Range: 548-554

Conference Proceedings Title: Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics

Event location: Sao Paulo BR

ISBN: 9781479931262

DOI: 10.1109/biorob.2014.6913835

Abstract

In this paper we evaluate ultrasound imaging as a human-machine interface in the context of rehabilitation. Ultrasound imaging can be used to estimate finger forces in real-time with a short and easy calibration procedure. Forces are individually predicted using a transducer fixed on the forearm, which leaves the hand completely free to operate. In this application, a standard ultrasound machine is connected to a virtual-reality environment in which a human operator can play a dynamic harmonium over two octaves, using either finger (including the thumb). The interaction in the virtual environment is managed via a fast collision detection algorithm and a physics engine. Ten human subjects have been engaged in two games of increasing difficulty. Our experimental results, both objective and subjective, clearly show that both tasks could be accomplished to the required degree of precision and that the subjects underwent a typical learning curve. The learning happened uniformly, irrespective of the required finger, force or note. Such a system could be made portable, and has potential applications as rehabilitation device for amputees and muscle impaired, even at home.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Castellini, C., Hertkorn, K., Sagardia, M., González, D.S., & Nowak, M. (2014). A virtual piano-playing environment for rehabilitation based upon ultrasound imaging. In Raffaella Carloni, Lorenzo Masia, Jose Maria Sabater-Navarro, Marko Ackermann, Sunil Agrawal, Arash Ajoudani, Panagiotis Artemiadis, Matteo Bianchi, Antonio Padilha Lanari Bo, Maura Casadio, Kevin Cleary, Ashish Deshpande, Domenico Formica, Matteo Fumagalli, Nicolas Garcia-Aracil, Sasha Blue Godfrey, Islam S.M. Khalil, Olivier Lambercy, Rui C. V. Loureiro, Leonardo Mattos, Victor Munoz, Hyung-Soon Park, Luis Eduardo Rodriguez Cheu, Roque Saltaren, Adriano A. G. Siqueira, Valentina Squeri, Arno H.A. Stienen, Nikolaos Tsagarakis, Herman Van der Kooij, Bram Vanderborght, Nicola Vitiello, Jose Zariffa, Loredana Zollo (Eds.), Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics (pp. 548-554). Sao Paulo, BR: IEEE Computer Society.

MLA:

Castellini, Claudio, et al. "A virtual piano-playing environment for rehabilitation based upon ultrasound imaging." Proceedings of the 5th IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2014, Sao Paulo Ed. Raffaella Carloni, Lorenzo Masia, Jose Maria Sabater-Navarro, Marko Ackermann, Sunil Agrawal, Arash Ajoudani, Panagiotis Artemiadis, Matteo Bianchi, Antonio Padilha Lanari Bo, Maura Casadio, Kevin Cleary, Ashish Deshpande, Domenico Formica, Matteo Fumagalli, Nicolas Garcia-Aracil, Sasha Blue Godfrey, Islam S.M. Khalil, Olivier Lambercy, Rui C. V. Loureiro, Leonardo Mattos, Victor Munoz, Hyung-Soon Park, Luis Eduardo Rodriguez Cheu, Roque Saltaren, Adriano A. G. Siqueira, Valentina Squeri, Arno H.A. Stienen, Nikolaos Tsagarakis, Herman Van der Kooij, Bram Vanderborght, Nicola Vitiello, Jose Zariffa, Loredana Zollo, IEEE Computer Society, 2014. 548-554.

BibTeX: Download