Generic Checkpointing Support for Stream-based State-Machine Replication

Lawniczak L, Ammon M, Distler T (2023)

Publication Language: English

Publication Type: Conference contribution

Publication year: 2023

Event location: Rome IT

URI: https://sys.cs.fau.de/publications/2023/lawniczak_23_papoc.pdf

DOI: 10.1145/3578358.3591329

Abstract

Stream-based replication facilitates the deployment and operation of state-machine replication protocols by running them as applications on top of data-stream processing frameworks. Taking advantage of platform-provided features, this approach makes it possible to significantly minimize implementation complexity at the protocol level. To further extend the associated benefits, in this paper we examine how the concept can be used to provide generic support for creating, storing, and applying checkpoints of replica states, both in the use case for catch up and garbage collection as well as to recover failed replicas. Specifically, we present three checkpointing-mechanism designs with different degrees of platform involvement and evaluate them in the context of Twitter's stream-processing engine Heron.

Authors with CRIS profile

Laura Lawniczak Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme) Tobias Distler Lehrstuhl für Informatik 4 (Systemsoftware)

Related research project(s)

Design and validation of scalable, Byzantine fault tolerant consensus algorithms for blockchains (BFT2Chain) Sept. 1, 2022 - Sept. 1, 2025 Energy-aware Execution Environments (E³) Jan. 1, 2018 - Jan. 1, 2021

How to cite

APA:

Lawniczak, L., Ammon, M., & Distler, T. (2023). Generic Checkpointing Support for Stream-based State-Machine Replication. In Proceedings of the Proceedings of the 10th Workshop on Principles and Practice of Consistency for Distributed Data (PaPoC '23). Rome, IT.

MLA:

Lawniczak, Laura, Marco Ammon, and Tobias Distler. "Generic Checkpointing Support for Stream-based State-Machine Replication." Proceedings of the Proceedings of the 10th Workshop on Principles and Practice of Consistency for Distributed Data (PaPoC '23), Rome 2023.

BibTeX: Download