yarn以及mapreduce部署

修改hadoop的配置文件yarn-site.xml：

<configuration>

<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.resourcemanager.hostname</name>
<value>ubuntu-00</value>
</property>

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

　　<property>
　　<name>yarn.nodemanager.vmem-check-enabled</name>
　　<value>false</value>
　　</property>

</configuration>

复制该配置文件到其他服务器

scp yarn-site.xml ubuntu-01:$PWD

yarn启动命令：

start-yarn.sh

MapReduce部署：

修改mapred-site.xml

<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>

<property>
 <name>mapreduce.jobhistory.address</name>
 <value>fireslate.cis.umac.mo:10020</value>
</property>
<property>
 <name>mapreduce.jobhistory.webapp.address</name>
 <value>fireslate.cis.umac.mo:19888</value>
</property>

<property>
<name>mapreduce.application.classpath</name>
        <value>
                $HADOOP_CONF_DIR,
                $HADOOP_COMMON_HOME/share/hadoop/common/*,
                $HADOOP_COMMON_HOME/share/hadoop/common/lib/*,
                $HADOOP_HDFS_HOME/share/hadoop/hdfs/*,
                $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,
                $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
                $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*,
                $HADOOP_YARN_HOME/share/hadoop/yarn/*,
                $HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
        </value>
</property>
</configuration>

修改mapred-env.sh，配置java_home

export JAVA_HOME=/home/ldy//home/ldy/apps/jdk1.8.0_221

yarn以及mapreduce部署

推荐阅读