阅读背景:

MapReduce(3): Partitioner, Combiner and Shuffling

来源:互联网 

Partitioner:

Partitioning and Combining take place between Map and Reduce phases. It is to club the data which should go to the same reducer based on keys. The number of partitioners is equal to the number of reducers. That means a partitioner will divide the data according to the number of reducers. Therefore, the data passed from a single partitioner is processed by a single Reducer. Partitioning and Combining take




你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: