A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication

Beitrag bei einer Tagung
(Konferenzbeitrag)


Details zur Publikation

Autor(en): Ziermann T, Mühleis N, Wildermann S, Teich J
Jahr der Veröffentlichung: 2010
Band: 2
Tagungsband: Proceedings of the 1st IEEE Workshop on Self-Organizing Real-Time systems (SORT 2010)
Seitenbereich: 11-20
ISBN: 9780769540382


Abstract


Due to the raising complexity in distributed embedded systems, a single designer will not be able to plan and organize the communication for such systems. Therefore, it will get more and more important to relieve the designer in that task. Our idea is a communication system that is capable to organize itself to satisfy predefined properties. In this paper, we want to solve the problem of establishing fair bandwidth sharing on priority-based buses by using simple local rules on the distributed system to avoid a single point of failure and cope with online system changes. Based on a game theoretical analysis, a multi-agent reinforcement learning algorithm is proposed that establishes fair bandwidth distribution. The main idea is to penalize nodes that claim too much bandwidth by the other nodes. We experimentally evaluated the algorithm with different parameter settings. The algorithm showed to converge to a fair solution in any experiment. This means the system is able to completely self-organize without global information for our assumptions. In addition, we could figure out that we can configure a trade-off between convergence speed and computation effort. We hope this is a small first step towards totally self-organizing real-time systems. © 2010 IEEE.



FAU-Autoren / FAU-Herausgeber

Teich, Jürgen Prof. Dr.-Ing.
Lehrstuhl für Informatik 12 (Hardware-Software-Co-Design)
Wildermann, Stefan Dr.-Ing.
Lehrstuhl für Informatik 12 (Hardware-Software-Co-Design)
Ziermann, Tobias
Lehrstuhl für Informatik 12 (Hardware-Software-Co-Design)


Zitierweisen

APA:
Ziermann, T., Mühleis, N., Wildermann, S., & Teich, J. (2010). A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication. In Proceedings of the 1st IEEE Workshop on Self-Organizing Real-Time systems (SORT 2010) (pp. 11-20). Carmona, Sevilla, ES.

MLA:
Ziermann, Tobias, et al. "A self-organizing distributed reinforcement learning algorithm to achieve fair bandwidth allocation for priority-based bus communication." Proceedings of the 2010 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing Workshops, ISORC Workshops 2010, Carmona, Sevilla 2010. 11-20.

BibTeX: 

Zuletzt aktualisiert 2018-25-10 um 21:50