Afzal A, Hager G, Wellein G (2026)
Publication Language: English
Publication Status: Submitted
Publication Type: Journal article
Future Publication Type: Journal article
Publication year: 2026
Publisher: arXiv
URI: https://www.sciencedirect.com/science/article/abs/pii/S0167819126000025
DOI: 10.1016/j.parco.2026.103184
Open Access Link: https://doi.org/10.1016/j.parco.2026.103184
We propose a novel, lightweight, and physically inspired approach to modeling the dynamics of parallel distributed-memory programs. Inspired by the Kuramoto model, we represent MPI processes as coupled oscillators with topology-aware interactions, custom coupling potentials, and stochastic noise. The resulting system of nonlinear ordinary differential equations opens a path to modeling key performance phenomena of parallel programs, including synchronization, delay propagation and decay, bottlenecks, and self-desynchronization.
This paper introduces interaction potentials to describe memory- and compute-bound workloads and employs multiple quantitative metrics -- such as an order parameter, synchronization entropy, phase gradients, and phase differences -- to evaluate phase coherence and disruption. We also investigate the role of local noise and show that moderate noise can accelerate resynchronization in scalable applications. Our simulations align qualitatively with MPI trace data, showing the potential of physics-informed abstractions to predict performance patterns, which offers a new perspective for performance modeling and software-hardware co-design in parallel computing.
APA:
Afzal, A., Hager, G., & Wellein, G. (2026). Exploring metrics for analyzing dynamic behavior in MPI programs via a coupled-oscillator model. Parallel Computing. https://doi.org/10.1016/j.parco.2026.103184
MLA:
Afzal, Ayesha, Georg Hager, and Gerhard Wellein. "Exploring metrics for analyzing dynamic behavior in MPI programs via a coupled-oscillator model." Parallel Computing (2026).
BibTeX: Download