Types of parallel computing


Up: Background Next: Communicating with other processes Previous: Parallel Computing

All use different data for each worker

Data-parallel
Same operations on different data. Also called SIMD
SPMD
Same program, different data
MIMD
Different programs, different data

SPMD and MIMD are essentially the same because any MIMD can be made SPMD

SIMD is also equivalent, but in a less practical sense.

MPI is primarily for SPMD/MIMD. HPF is an example of a SIMD interface.



Up: Background Next: Communicating with other processes Previous: Parallel Computing