Chronix: Long Term Storage and Retrieval Technology for Anomaly Detection in Operational Data

Lautenschlager F, Philippsen M, Kumlehn A, Adersberger J (2017)


Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2017

Pages Range: 229-242

Conference Proceedings Title: Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST 17)

Event location: Santa Clara, CA US

ISBN: 978-1-931971-36-2

URI: https://www.usenix.org/system/files/conference/fast17/fast17-lautenschlager.pdf

Open Access Link: https://www.usenix.org/conference/fast17/technical-sessions/presentation/lautenschlager

Abstract

Anomalies in the runtime behavior of software systems, especially in distributed systems, are inevitable, expensive, and hard to locate. To detect and correct such anomalies (like instability due to a growing memory consumption, failure due to load spikes, etc.) one has to automatically collect, store, and analyze the operational data of the runtime behavior, often represented as time series. There are efficient means both to collect and analyze the runtime behavior. But traditional time series databases do not yet focus on the specific needs of anomaly detection (generic data model, specific built-in functions, storage efficiency, and fast query execution).

The paper presents Chronix, a domain specific time series database targeted at anomaly detection in operational data. Chronix uses an ideal compression and chunking of the time series data, a methodology for commissioning Chronix’ parameters to a sweet spot, a way of enhancing the data with attributes, an expandable set of analysis functions, and other techniques to achieve both faster query times and a significantly smaller memory footprint. On benchmarks Chronix saves 20%–68% of the space that other time series databases need to store the data and saves 80%–92% of the data retrieval time and 73%–97% of the runtime of analyzing functions.

 

Authors with CRIS profile

How to cite

APA:

Lautenschlager, F., Philippsen, M., Kumlehn, A., & Adersberger, J. (2017). Chronix: Long Term Storage and Retrieval Technology for Anomaly Detection in Operational Data. In USENIX Association (Eds.), Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST 17) (pp. 229-242). Santa Clara, CA, US.

MLA:

Lautenschlager, Florian, et al. "Chronix: Long Term Storage and Retrieval Technology for Anomaly Detection in Operational Data." Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST 17), Santa Clara, CA Ed. USENIX Association, 2017. 229-242.

BibTeX: Download