Parallel I/O Benchmarks

Since I am often asked if I know of any parallel I/O benchmarks that are available, I have put together a list of the ones I am aware of (in no particular order). If you know of any benchmarks/applications that can be added to this list, let me (Rajeev Thakur) know.

Updated: December 10, 2012

Benchmarks

  1. FLASH I/O
    http://www.ucolick.org/~zingale/flash_benchmark_io/
    An updated version for newer versions of parallel NetCDF and HDF-5 is available     here.

  2. IOR
    http://sourceforge.net/projects/ior-sio

  3. Effective I/O Bandwidth Benchmark (b_eff_io)
    http://www.hlrs.de/mpi/b_eff_io/

  4. NAS BTIO Benchmark
    http://www.nas.nasa.gov/Resources/Software/npb.html (see BT in NPB3.3-MPI)

  5. MPI Tile I/O
    http://www.mcs.anl.gov/pio-benchmark/

  6. FS_TEST
    https://github.com/fs-test/fs_test (see this as a README)

  7. Trace-Driven Scientific I/O Benchmarks
    http://www.cs.rochester.edu/research/os/iobench/

  8. HPIO and S3asim
    http://www.eecs.northwestern.edu/~aching/research_webpage/io.html

  9. Noncontig
    http://www.mcs.anl.gov/pio-benchmark/

  10. ioperf test in Silo
    https://wci.llnl.gov/codes/silo/

  11. Pattern I/O Benchmark (John Shalf, LBNL)
    pattern_io.tar.gz

  12. MADbench2
    http://crd.lbl.gov/~borrill/MADbench2/

  13. QIO
    http://usqcd.jlab.org/usqcd-docs/qio/

  14. PIO-Bench
    ftp://ftp.parl.clemson.edu/pub/pio-bench
    An article describing it is at     http://www.clustermonkey.net/content/view/87/32/.

  15. Parkbench I/O Benchmarks
    http://www.performance.ecs.soton.ac.uk/projects.html

Applications

  1. Earth System Modeling Framework (ESMF)
    http://www.earthsystemmodeling.org/

  2. Nek5000
    http://nek5000.mcs.anl.gov/

  3. NekCEM
    http://wiki.mcs.anl.gov/nekcem/index.php/Main_Page

  4. MOAB
    http://trac.mcs.anl.gov/projects/ITAPS/wiki/MOAB

  5. PFLOTRAN
    http://www.secure-water.org/wiki/index.php?title=PFLOTRAN_Instructions_2011

  6. Cactus
    http://www.cactuscode.org/

  7. mpiBLAST
    http://www.mpiblast.org/

  8. FLASH
    http://www.flash.uchicago.edu/
    Also see FLASH I/O Benchmark above.

  9. Community Earth System Model (CESM)
    http://www.cesm.ucar.edu/

  10. Regional Ocean Modeling System (ROMS)
    https://www.myroms.org/

  11. Global Cloud Resolving Model (GCRM)
    https://svn.pnl.gov/gcrm

  12. Weather Research & Forecasting Model (WRF)
    http://www.mmm.ucar.edu/wrf/users/downloads.html

  13. CM1
    http://www.mmm.ucar.edu/people/bryan/cm1/

  14. Qbox
    http://eslab.ucdavis.edu/software/qbox/

  15. GADGET
    http://www.mpa-garching.mpg.de/gadget/

  16. MAESTRO
    NERSC web site

  17. MILC
    http://www.physics.utah.edu/~detar/milc/

  18. MPQC
    http://www.mpqc.org/

  19. NaSt3DGP
    http://wissrech.ins.uni-bonn.de/research/projects/NaSt3DGP/index.htm

  20. SIESTA
    http://www.icmab.es/siesta/

  21. CP2K
    http://cp2k.berlios.de/

  22. LAMMPS
    http://lammps.sandia.gov/

Traces

  1. PLFS
    http://institutes.lanl.gov/plfs/maps/

  2. LANL
    http://institute.lanl.gov/data/tdata/

  3. Sandia
    http://www.cs.sandia.gov/Scalable_IO/SNL_Trace_Data/index.html

  4. MAMBO
    http://www.cs.umd.edu/projects/hpsl/mambo/index.html