Publications of Torsten Hoefler

Torsten Hoefler and Timo Schneider and Andrew Lumsdaine:

The Effect of Network Noise on Large-Scale Collective Communications

(Parallel Processing Letters (PPL). Vol 19, Nr. 4, pages 573-593, World Scientific Publishing Company, Aug. 2009)

Abstract

The effect of operating system (OS) noise on the performance of large-scale applications is a growing concern and ameliorating the influence of OS noise is a subject of active research. A related problem is that of network noise which arises from the shared use of the interconnection network by parallel processes of different allocations or other background processes. To characterize the effect of network noise on parallel applications we conducted a series of experiments with a specially crafted benchmark and simulations. Experimental results show a decrease in the communication performance of a parallel reduction operation by a factor of 2 on 246 nodes on an InfiniBand fat-tree and by several orders of magnitude on a BlueGene/P torus. Simulations show how influence of network noise grows with the system size. Although network noise is not as well-studied as OS noise, our results clearly show that it is an important factor that must be considered when running and analyzing large-scale applications.

Documents

download article:

BibTeX

@article{hoefler-collnetnoise,
  author={Torsten Hoefler and Timo Schneider and Andrew Lumsdaine},
  title={{The Effect of Network Noise on Large-Scale Collective Communications}},
  journal={Parallel Processing Letters (PPL)},
  year={2009},
  month={Aug.},
  pages={573-593},
  volume={19},
  number={4},
  publisher={World Scientific Publishing Company},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 18.188.227.108:3943	© Torsten Hoefler