Identifying Load Imbalances
Identifying Load Imbalances
- Identifying (distinguishing from latency/synchronization overhead)
- Poor load balance focuses attention on collective operations because the implicit synchronization of the collective operation �equalizes� the time taken on each process
- Can generate the appearance of good load balance if not timed correctly