Publications of Torsten Hoefler

Roberto Belli, Torsten Hoefler:

Notified Access: Extending Remote Memory Access Programming Models for Producer-Consumer Synchronization

(In Proceedings of the 29th IEEE International Parallel & Distributed Processing Symposium (IPDPS'15), presented in Hyderabad, India, IEEE, May 2015)
Best Paper at IPDPS'15 (4/108)

Abstract

Remote Memory Access (RMA) programming enables direct access to low-level hardware features to achieve high performance for distributed-memory programs. However, the design of RMA programming schemes focuses on the memory access and less on process synchronization. For example, in contemporary RMA programming systems, the widely used producer-consumer pattern can only be implemented inefficiently, incurring the overhead of an additional round-trip message. We propose Notified Access, a scheme where the target process of an access can receive a completion notification. This scheme enables direct and efficient synchronization with a minimum number of messages. We implement our scheme in an open source MPI-3 RMA library and demonstrate lower overheads (two cache misses) than other point-to-point synchronization mechanisms. We also evaluate our implementation on three real-world benchmarks: a stencil computation, a tree computation, and a Cholesky factorization implemented with tasks. Our scheme always performs better than traditional message passing and other existing RMA synchronization schemes, providing up to 50% speedup on small messages. Our analysis shows that Notified Access is a valuable primitive for any RMA system. Furthermore, we provide guidance for the design of low-level network interfaces to support Notified Access efficiently.

Documents

download article:

download slides:

BibTeX

@inproceedings{notified-access,
  author={Roberto Belli and Torsten Hoefler},
  title={{Notified Access: Extending Remote Memory Access Programming Models for Producer-Consumer Synchronization}},
  year={2015},
  month={May},
  booktitle={Proceedings of the 29th IEEE International Parallel \& Distributed Processing Symposium (IPDPS'15)},
  location={Hyderabad, India},
  publisher={IEEE},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 13.58.200.16:32975	© Torsten Hoefler