Analysis of Communication Tradeoff

Per iteration costs
- Tw - computation (work)
- Tc - communication (latency bound)
- n - steps per communication (when blocked)
- m - total number of steps
Optimal block size:
- minimize overhead: (m/n)Tc + n/2 Tw