创建本地Hadoop集群
一 Hadoop需要的环境支持
1、操作系统的支持
Linux
Windows
——Cygwin
——hadoop-for-windows
2、JDK的支持
安装完成后，再配置环境变量，最后查询版本
[[email protected] opt]# java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
二 初学者应该选用哪个版本的Hadoop
三 如何安装和配置Hadoop
1、下载安装
2、设置环境
2.1 设置环境变量
[[email protected] opt]# cat /etc/profile
export JAVA_HOME=/opt/jdk1.8
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export HADOOP_HOME=/opt/hadoop-1.2.1
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin
2.2 配置相关文件
[[email protected] conf]# cat hadoop-env.sh
export JAVA_HOME=/opt/jdk1.8
3 设置SSH免密码登录并测试
[[email protected] conf]# ssh-******
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
9f:63:e4:3d:a4:96:12:e7:60:12:bd:77:95:98:5b:32
[email protected]ldomain
The key's randomart image is:
+--[ RSA 2048]----+
| |
| . o . |
| . . E + |
| . . * |
| . S + + |
| o X B |
| . @ o |
| + . . |
| |
+-----------------+
[[email protected] conf]# cp /root/.ssh/id_rsa.pub /root/.ssh/authorized_keys
[[email protected] conf]# ssh localhost
\S
Kernel \r on an \m
Last login: Fri Dec 8 20:30:45 2017 from 192.168.0.103
hello cakin24!