Up: Background
Next: Communicating with other processes
Previous: Parallel Computing
All use different data for each worker
-
Data-parallel
-
Same operations on different data. Also called SIMD
-
SPMD
-
Same program, different data
-
MIMD
-
Different programs, different data
SPMD and MIMD are essentially the same because any MIMD can
be made SPMD
SIMD is also equivalent, but in a less practical sense.
MPI is primarily for SPMD/MIMD. HPF is an example of a SIMD interface.
Up: Background
Next: Communicating with other processes
Previous: Parallel Computing