首页 > 技术文章 > 三、Hadoop单机模式安装配置

momo6656 2021-08-23 16:43 原文

3.1 •Hadoop的部署模式有三种
–单机
–伪分布式
–完全分布式
3.2 Hadoop单机模式安装配置
•Hadoop的单机模式安装非常简单
–1、获取软件
http://hadoop.apache.org
–2、安装配置java 环境,安装jps工具
安装Openjdk和openjdk-devel
–3、设置环境变量,启劢运行
–hadoop-env.sh
JAVA_HOME=“”
•Hadoop的单机模式安装非常简单,只需要配置好环境变量即可运行,这个模式一般用来学习和测试hadoop的功能
–测试---统计词频
cd/usr/local/hadoop
mkdir  input
cp *.txt input/
./bin/hadoopjar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcountinput output
----------------------------------------------------------------------------------------------------------------------
练习
[root@es1 ~]# echo node1 >/etc/hostname
[root@es1 ~]# hostname node1
[root@es1 ~]# vim /etc/hosts
192.168.0.10 node1
[root@es1 ~]# yum -y install java-1.8.0-openjdk-devel
[root@es1 ~]# jps 查看进程id
683 Elasticsearch
1356 Jps
[root@room8pc205 ~]# scp hadoop/hadoop-2.7.6.tar.gz root@192.168.0.10:/root
[root@node1 ~]# tar -xf hadoop-2.7.6.tar.gz
[root@node1 ~]# mv hadoop-2.7.6 /usr/local/hadoop
[root@node1 ~]# cd /usr/local/hadoop
[root@node1 hadoop]# rpm -ql java-1.8.0-openjdk 查看java家目录
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre/bin/policytool
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre/lib/amd64/libawt_xawt.so
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre/lib/amd64/libjawt.so
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre/lib/amd64/libjsoundalsa.so
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre/lib/amd64/libsplashscreen.so
[root@node1 hadoop]# pwd
/usr/local/hadoop/etc/hadoop
[root@node1 hadoop]# vim hadoop-env.sh
25 export JAVA_HOME="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/jre"
33 export HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
[root@node1 ~]# cd /usr/local/hadoop/
[root@node1 hadoop]# ./bin/hadoop version
Hadoop 2.7.6
Subversion https://shv@git-wip-us.apache.org/repos/asf/hadoop.git -r 085099c66cf28be31604560c376fa282e69282b8
Compiled by kshvachk on 2018-04-18T01:33Z
Compiled with protoc 2.5.0
From source with checksum 71e2695531cb3360ab74598755d036
This command was run using /usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.6.jar

推荐阅读