Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Simpetru R, Oßwald M, Braun D, Souza de Oliveira D, Cakici A, Del Vecchio A (2022)


Publication Language: English

Publication Status: Published

Publication Type: Conference contribution, Conference Contribution

Publication year: 2022

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 702-706

Event location: Scottish Event Campus, Glasgow, UK GB

ISBN: 9781728127828

DOI: 10.1109/EMBC48229.2022.9870937

Abstract

Natural control of assistive devices requires continuous positional encoding and decoding of the user's volition. Human movement is encoded by recruitment and rate coding of spinal motor units. Surface electromyography provides some information on the neural code of movement and is usually decoded into finger joint angles. However, the current approaches to mapping the electrical signal into joint angles are unsatisfactory. There are no methods that allow precise estimation of joint angles during natural hand movements within the large numbers of degrees of freedom of the hand. We propose a framework to train a neural network from digital cameras and high-density surface electromyography from the extrinsic (forearm and wrist) hand muscles. Furthermore, we show that our 3D convolutional neural network optimally predicted 14 functional flexion/extension joints of the hand. We found in our experiments (4 subjects; mean age of 26 +- 2.12 years) that our model can predict individual sinusoidal finger movement at different speeds (0.5 and 1.5 Hz), as well as two and three finger pinching, and hand opening and closing, covering 14 degrees of freedom of the hand. Our deep learning method shows a mean absolute error of 2.78 +- 0.28 degrees with a mean correlation coefficient between predicted and expected joint angles of 0.94, 95% confidence interval (CI) [0.81, 0.98] with simulated real-time inference times lower than 30 milliseconds. These results demonstrate that our approach is capable of predicting the user's volition similar to digital cameras through a non-invasive wearable neural interface. Clinical relevance— This method establishes a viable interface that can be used for both immersive virtual reality medical simulations environments and assistive devices such as exoskeleton and prosthetics

Authors with CRIS profile

How to cite

APA:

Simpetru, R., Oßwald, M., Braun, D., Souza de Oliveira, D., Cakici, A., & Del Vecchio, A. (2022). Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning. In Proceedings of the 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022 (pp. 702-706). Scottish Event Campus, Glasgow, UK, GB: Institute of Electrical and Electronics Engineers Inc..

MLA:

Simpetru, Raul, et al. "Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning." Proceedings of the 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022, Scottish Event Campus, Glasgow, UK Institute of Electrical and Electronics Engineers Inc., 2022. 702-706.

BibTeX: Download