Hadoop-3.x.x配置LZOP压缩

Hadoop配置文件core-site.xml

添加下列配置

<configuration>
    <property>
        <name>io.compression.codecs</name>
        <value>
            org.apache.hadoop.io.compress.GzipCodec,
            org.apache.hadoop.io.compress.DefaultCodec,
            org.apache.hadoop.io.compress.BZip2Codec,
            org.apache.hadoop.io.compress.SnappyCodec,
            com.hadoop.compression.lzo.LzoCodec,
            com.hadoop.compression.lzo.LzopCodec
        </value>
    </property>

    <property>
        <name>io.compression.codec.lzo.class</name>
        <value>com.hadoop.compression.lzo.LzoCodec</value>
    </property>
</configuration>

将jar(点击下载，提取码 jlpb)丢进${HADOOP_HOME}/share/hadoop/common下

重启HDFS集群即可

至于这个jar怎么来的，等有空我整理在后面把，先干活

Hadoop-3.x.x配置LZOP压缩

推荐阅读