SHARQ: Software-Defined Hardware-Managed Queues for Tile-Based Manycore Architectures

Rheindt S, Maier S, Schmaus F, Wild T, Schröder-Preikschat W, Herkersdorf A (2019)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2019

Publisher: Springer-Verlag

Conference Proceedings Title: Proceedings of the 19th International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS)

Event location: Samos GR

DOI: 10.1007/978-3-030-27562-4_15

Abstract

The recent trend towards tile-based manycore architectures has helped to tackle the memory wall by physically distributing memories and processing nodes. Distributed operating systems and applications allow to exploit the increased scalability of such architectures, but still face the data-to-task locality challenge. As inter-tile communication, thread synchronization and data transport often impose significant software overhead on such architectures, many applications would benefit from a more efficient and powerful communication primitive with minimal software involvement.

We propose software-defined hardware-managed queues for distributed computing architectures that enable efficient inter-tile communication by leveraging application-specific queues with arbitrarily sized elements. To ensure (remote) processing of queued elements, SHARQ introduces the concept of an optional handler task, which is scheduled by hardware on demand. Queue and memory management, intra- and inter-tile data transfer, and handler task invocation are entirely handled by hardware. Only the dynamic queue creation at runtime is performed in software. As an example use-case, we integrated SHARQ into the MPI library. The evaluation with the MPI-based NAS benchmarks shows a reduction in execution time by up to 48% for the communication intense IS kernel in a 4x4 tile design on an FPGA platform with a total of 80 LEON3 cores.

Authors with CRIS profile

Sebastian Maier Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme) Florian Schmaus Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme) Wolfgang Schröder-Preikschat Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)

Related research project(s)

DFG SFB/Transregio 89 "Invasive Computing" (TRR 89) July 1, 2010 - Dec. 31, 2022

Involved external institutions

Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Rheindt, S., Maier, S., Schmaus, F., Wild, T., Schröder-Preikschat, W., & Herkersdorf, A. (2019). SHARQ: Software-Defined Hardware-Managed Queues for Tile-Based Manycore Architectures. In Proceedings of the 19th International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS). Samos, GR: Springer-Verlag.

MLA:

Rheindt, Sven, et al. "SHARQ: Software-Defined Hardware-Managed Queues for Tile-Based Manycore Architectures." Proceedings of the 19th International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS), Samos Springer-Verlag, 2019.

BibTeX: Download