Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams

Mutschler C, Philippsen M (2013)

Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2013

Edited Volumes: Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium, IPDPS 2013

Pages Range: 1133-1144

Conference Proceedings Title: Proceedings of 27th International Parallel and Distributed Processing Symposium (IPDPS'13)

Event location: Boston, Massachusetts US

ISBN: 978-1-4673-6066-1

URI: http://www2.informatik.uni-erlangen.de/publication/download/IPDPS2013.pdf

DOI: 10.1109/IPDPS.2013.29

Abstract

Event-based Systems (EBS) are used to detect and analyze meaningful events in surveillance, sports, finances and many other areas. With rising data and event rates and with correlations among these events, sequential event processing becomes infeasible and needs to be distributed. Existing approaches cannot deal with the ubiquity of out-of-order event arrival that is introduced by network delays when distributing EBS. Order-less event processing may result in a system failure. We present a low-latency approach based on K-slack that achieves ordered event processing on high data rate sensor and event streams without a-priori knowledge. Slack buffers are dynamically adjusted to fit the disorder in the streams without using local or global clocks. The middleware transparently reorders the event input streams so that events can still be aggregated and processed to a granularity that satisfies the demands of the application. On a Real time Locating System (RTLS) our system performs accurate low-latency event detection under the predominance of out-of-order vent arrival and with a close to linear performance scale-up when the system is distributed over several threads and machines. © 2013 IEEE.

Authors with CRIS profile

Christopher Mutschler Lehrstuhl für Informatik 2 (Programmiersysteme) Michael Philippsen Lehrstuhl für Informatik 2 (Programmiersysteme)

How to cite

APA:

Mutschler, C., & Philippsen, M. (2013). Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams. In Proceedings of 27th International Parallel and Distributed Processing Symposium (IPDPS'13) (pp. 1133-1144). Boston, Massachusetts, US.

MLA:

Mutschler, Christopher, and Michael Philippsen. "Distributed Low-Latency Out-of-Order Event Processing for High Data Rate Sensor Streams." Proceedings of the 27th IEEE International Parallel & Distributed Processing Symposium (IPDPS'13), Boston, Massachusetts 2013. 1133-1144.

BibTeX: Download