Home Publications Research Grants Inventions & Patents Awards Additional Research Activities Faculties & Institutions Research Areas

Verb Motility Dynamics Reveals Cognitive Impairment in Parkinson’s Disease: A Speech-Language Fusion Approach

Mercado-Agudelo JF, Escobar-Grisales D, Ríos-Urrego CD, García AM, Bocanegra Y, Moreno L, Nöth E, Orozco-Arroyave JR (2026)

---

Publication Type: Conference contribution

Publication year: 2026

Journal

Publisher: Springer Science and Business Media Deutschland GmbH

Book Volume: 16030 LNAI

Pages Range: 287-298

Conference Proceedings Title: Lecture Notes in Computer Science

Event location: Erlangen, DEU

ISBN: 9783032025500

DOI: 10.1007/978-3-032-02551-7_25

Abstract

Parkinson’s disease (PD) and mild cognitive impairment (MCI) affect both motor and cognitive linguistic abilities. This work proposes a multimodal framework for detecting PD and MCI from naturalistic retelling tasks by combining acoustic and linguistic features. Speech features capture prosodic, articulatory, and phonemic properties linked to hypokinetic dysarthria, while language features model lexical, syntactic, and semantic complexity, including a novel motility-based representation that quantifies the use of action-related verbs. Each modality is independently evaluated and combined following early and late fusion strategies based on support vector machines. The results confirm speech features as good biomarkers to model PD and MCI, and show the motility-based language features improve specificity, particularly in distinguishing cognitive decline in Parkinson’s patients, i.e., PD patients with MCI vs. patients without MCI. Fusion strategies further improve classification performance, confirming the complementarity of speech and language. These findings support the use of retelling-based multimodal analyses as promising tools for early and non-invasive screening of neurodegenerative conditions.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Mercado-Agudelo, J.F., Escobar-Grisales, D., Ríos-Urrego, C.D., García, A.M., Bocanegra, Y., Moreno, L.,... Orozco-Arroyave, J.R. (2026). Verb Motility Dynamics Reveals Cognitive Impairment in Parkinson’s Disease: A Speech-Language Fusion Approach. In Kamil Ekštein, Miloslav Konopík, Ondrej Pražák, František Pártl (Eds.), Lecture Notes in Computer Science (pp. 287-298). Erlangen, DEU: Springer Science and Business Media Deutschland GmbH.

MLA:

Mercado-Agudelo, Jhon Fredy, et al. "Verb Motility Dynamics Reveals Cognitive Impairment in Parkinson’s Disease: A Speech-Language Fusion Approach." Proceedings of the 28th International Conference on Text, Speech, and Dialogue, TSD 2025, Erlangen, DEU Ed. Kamil Ekštein, Miloslav Konopík, Ondrej Pražák, František Pártl, Springer Science and Business Media Deutschland GmbH, 2026. 287-298.

BibTeX: Download