Trading Communication for Computation
Trading Communication for Computation
- For slowly converging algorithms, taking a number of steps and then checking convergence (rather than checking at each iteration) is another form of blocking
- Can trade bandwidth/computation for latency (unroll a compute loop once, do a single send of more data, do duplicate computation)