July 6, 2009

bashreduce: A Bare-Bones MapReduce

Article Source Linux Magazine
July 6, 2009, 5:57 am

In late 2004, Google surprised the world of computing with the release of the paper MapReduce: Simplified Data Processing on Large Clusters. That paper ushered in a new model for data processing across clusters of machines that had the benefit of being simple to understand and incredibly flexible. Once you adopt a MapReduce way of thinking, dozens of previously difficult or long-running tasks suddenly start to seem approachable–if you have sufficient hardware.

If you’ve managed to somehow miss most of the MapReduce revolution, Wikipedia describes it pretty well...

Read More