A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication

Ziermann T, Mühleis N, Wildermann S, Teich J (2010)


Publication Status: Published

Publication Type: Conference contribution, Conference Contribution

Publication year: 2010

Book Volume: 2

Pages Range: 11-20

Article Number: 5479531

Conference Proceedings Title: Proceedings of the 1st IEEE Workshop on Self-Organizing Real-Time systems (SORT 2010)

Event location: Carmona, Sevilla ES

ISBN: 9780769540382

DOI: 10.1109/ISORCW.2010.18

Abstract

Due to the raising complexity in distributed embedded systems, a single designer will not be able to plan and organize the communication for such systems. Therefore, it will get more and more important to relieve the designer in that task. Our idea is a communication system that is capable to organize itself to satisfy predefined properties. In this paper, we want to solve the problem of establishing fair bandwidth sharing on priority-based buses by using simple local rules on the distributed system to avoid a single point of failure and cope with online system changes. Based on a game theoretical analysis, a multi-agent reinforcement learning algorithm is proposed that establishes fair bandwidth distribution. The main idea is to penalize nodes that claim too much bandwidth by the other nodes. We experimentally evaluated the algorithm with different parameter settings. The algorithm showed to converge to a fair solution in any experiment. This means the system is able to completely self-organize without global information for our assumptions. In addition, we could figure out that we can configure a trade-off between convergence speed and computation effort. We hope this is a small first step towards totally self-organizing real-time systems. © 2010 IEEE.

Authors with CRIS profile

Related research project(s)

How to cite

APA:

Ziermann, T., Mühleis, N., Wildermann, S., & Teich, J. (2010). A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication. In Proceedings of the 1st IEEE Workshop on Self-Organizing Real-Time systems (SORT 2010) (pp. 11-20). Carmona, Sevilla, ES.

MLA:

Ziermann, Tobias, et al. "A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication." Proceedings of the 2010 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing Workshops, ISORC Workshops 2010, Carmona, Sevilla 2010. 11-20.

BibTeX: Download