阅读背景:

Hadoop,如何压缩映射器输出而不是减速器输出

来源:互联网 

I have a map-reduce java program in which I try to only compress the mapper output but not the reducer output. I thought that this would be possible by setting the following properties in the Configuration instance as listed below. However, when I run my job, the generated output by the reducer still is compressed since the file generated is: part-r-00000.gz. Has anyone successfully just compressed the mapper data but not the reducer? Is that even possible?I have a map-reduce java program in which I try




你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: