Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams

Conference contribution
(Original article)


Publication Details

Author(s): Mutschler C, Philippsen M
Title edited volumes: Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium, IPDPS 2013
Publication year: 2013
Conference Proceedings Title: Proceedings of 27th International Parallel and Distributed Processing Symposium (IPDPS'13)
Pages range: 1133-1144
ISBN: 978-1-4673-6066-1
Language: English


Abstract


Event-based Systems (EBS) are used to detect and analyze meaningful events in surveillance, sports, finances and many other areas. With rising data and event rates and with correlations among these events, sequential event processing becomes infeasible and needs to be distributed. Existing approaches cannot deal with the ubiquity of out-of-order event arrival that is introduced by network delays when distributing EBS. Order-less event processing may result in a system failure. We present a low-latency approach based on K-slack that achieves ordered event processing on high data rate sensor and event streams without a-priori knowledge. Slack buffers are dynamically adjusted to fit the disorder in the streams without using local or global clocks. The middleware transparently reorders the event input streams so that events can still be aggregated and processed to a granularity that satisfies the demands of the application. On a Real time Locating System (RTLS) our system performs accurate low-latency event detection under the predominance of out-of-order vent arrival and with a close to linear performance scale-up when the system is distributed over several threads and machines. © 2013 IEEE.



FAU Authors / FAU Editors

Mutschler, Christopher Dr.-Ing.
Lehrstuhl für Informatik 2 (Programmiersysteme)
Philippsen, Michael Prof. Dr.
Lehrstuhl für Informatik 2 (Programmiersysteme)


How to cite

APA:
Mutschler, C., & Philippsen, M. (2013). Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams. In Proceedings of 27th International Parallel and Distributed Processing Symposium (IPDPS'13) (pp. 1133-1144). Boston, Massachusetts, US.

MLA:
Mutschler, Christopher, and Michael Philippsen. "Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams." Proceedings of the 27th IEEE International Parallel & Distributed Processing Symposium (IPDPS'13), Boston, Massachusetts 2013. 1133-1144.

BibTeX: 

Last updated on 2018-14-05 at 07:08