NodeManager 和DataNode 需要进行一一对应的搭建。放在同一个服务器中。 参考: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html

    yarn的ha搭建参考: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html

    etc/hadoop/mapred-site.xml:

    1. <configuration>
    2.     <property>
    3.         <name>mapreduce.framework.name</name>
    4.         <value>yarn</value>
    5.     </property>
    6.   <property>
    7.         <name>mapreduce.application.classpath</name>
    8.         <value>/opt/bigdata/hadoop-3.2.1/etc/hadoop:/opt/bigdata/hadoop-3.2.1/share/hadoop/common/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/common/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/mapreduce/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/mapreduce/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn/*</value>
    9.     </property>
    10. </configuration>

    etc/hadoop/yarn-site.xml:

    <configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
  <!-- 通过 hadoop classpath 查看路径 -->
  <property>
        <name>yarn.nodemanager.env-whitelist</name>
        <value>/opt/bigdata/hadoop-3.2.1/etc/hadoop:/opt/bigdata/hadoop-3.2.1/share/hadoop/common/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/common/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/hdfs/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/mapreduce/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/mapreduce/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn/lib/*:/opt/bigdata/hadoop-3.2.1/share/hadoop/yarn/*</value>
    </property>
</configuration>

    执行 start-yarn.sh

    访问: node1:8088 打开后台管理界面。