W. Gropp and E. Lusk, "Fault Tolerance in MPI Programs," International Journal of High Performance Computing Applications, vol. 18, no. 3, 1969, pp. 363-372, . [pdf]
This paper examines the topic of writing fault-tolerant MPI applications. We discuss the meaning of fault tolerance in general and what the MPI Standard has to say about it. We survey several approaches to this problem, namely checkpointing, restructuring a class of standard MPI program, modifying MPI semantics, and extending the MPI specification. We conclude that within certain constraints, MPI can provide a useful context for writing application programs that exhibit significant degrees of fault tolerance.