An Evaluation of Different I/O Techniques for Checkpoint/Restart

Shahzad F, Wittmann M, Zeiser T, Hager G, Wellein G (2013)


Publication Language: English

Publication Type: Conference contribution

Publication year: 2013

Publisher: IEEE Digital Library

Edited Volumes: Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013

City/Town: n.a.

Pages Range: 1708-1716

Conference Proceedings Title: Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW), 2013 IEEE 27th International

Event location: Boston, MA, USA

DOI: 10.1109/IPDPSW.2013.145

Abstract

Today's High Performance Computing (HPC) clusters consist of hundreds of thousands of CPUs, memory units, complex networks, and other components. Such an extreme level of hardware parallelism reduces the mean time to failure (MTTF) of the overall cluster. The future of HPC urgently demands to develop environments that facilitate programs to run successfully even in the presence of failures. Checkpoint/Restart (C/R) is one of the most common techniques to provide fault tolerance. C/R is relatively easy to implement, but typically it introduces significant overhead in the runtime of the application. In this paper, a check pointing technique is presented that significantly reduces the checkpoint overhead and is highly scalable. This is achieved by overlapping the I/O for writing the checkpoint with the computation of the application. For this asynchronous check pointing technique, a theoretical model is developed to estimate the checkpoint overhead. An implementation of this technique is then benchmarked and compared with other check pointing strategies. We show our approach to have marginal overhead as opposite to standard synchronous check pointing for typical application scenarios. A comparison with the node-level check pointing technique by using Scalable Checkpoint/Restart (SCR) library is also presented. © 2013 IEEE.

Authors with CRIS profile

How to cite

APA:

Shahzad, F., Wittmann, M., Zeiser, T., Hager, G., & Wellein, G. (2013). An Evaluation of Different I/O Techniques for Checkpoint/Restart. In Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW), 2013 IEEE 27th International (pp. 1708-1716). Boston, MA, USA: n.a.: IEEE Digital Library.

MLA:

Shahzad, Faisal, et al. "An Evaluation of Different I/O Techniques for Checkpoint/Restart." Proceedings of the 2013 IEEE 27th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, Boston, MA, USA n.a.: IEEE Digital Library, 2013. 1708-1716.

BibTeX: Download