Shahzad F, Wittmann M, Zeiser T, Hager G, Wellein G (2013)
Publication Language: English
Publication Type: Conference contribution
Publication year: 2013
Publisher: IEEE Digital Library
Edited Volumes: Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013
City/Town: n.a.
Pages Range: 1708-1716
Conference Proceedings Title: Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW), 2013 IEEE 27th International
Event location: Boston, MA, USA
Today's High Performance Computing (HPC) clusters consist of hundreds of thousands of CPUs, memory units, complex networks, and other components. Such an extreme level of hardware parallelism reduces the mean time to failure (MTTF) of the overall cluster. The future of HPC urgently demands to develop environments that facilitate programs to run successfully even in the presence of failures. Checkpoint/Restart (C/R) is one of the most common techniques to provide fault tolerance. C/R is relatively easy to implement, but typically it introduces significant overhead in the runtime of the application. In this paper, a check pointing technique is presented that significantly reduces the checkpoint overhead and is highly scalable. This is achieved by overlapping the I/O for writing the checkpoint with the computation of the application. For this asynchronous check pointing technique, a theoretical model is developed to estimate the checkpoint overhead. An implementation of this technique is then benchmarked and compared with other check pointing strategies. We show our approach to have marginal overhead as opposite to standard synchronous check pointing for typical application scenarios. A comparison with the node-level check pointing technique by using Scalable Checkpoint/Restart (SCR) library is also presented. © 2013 IEEE.
APA:
Shahzad, F., Wittmann, M., Zeiser, T., Hager, G., & Wellein, G. (2013). An Evaluation of Different I/O Techniques for Checkpoint/Restart. In Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW), 2013 IEEE 27th International (pp. 1708-1716). Boston, MA, USA: n.a.: IEEE Digital Library.
MLA:
Shahzad, Faisal, et al. "An Evaluation of Different I/O Techniques for Checkpoint/Restart." Proceedings of the 2013 IEEE 27th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, Boston, MA, USA n.a.: IEEE Digital Library, 2013. 1708-1716.
BibTeX: Download