As Beowulf-style clusters have proliferated, many computational scientists have discovered that, although clusters provide adequate CPU performance for most applications, more finely-grained models are often limited by the performance of the network that interconnects nodes.
Link: Linux Magazine