1、下载Ubuntu server
https://www.ubuntu.com/download/alternative-downloads
http://releases.ubuntu.com/16.04/ubuntu-16.04.4-server-amd64.iso.torrent
下载16.04 server版备用。
2、建立虚拟机
选择自定义类型
采用简易方式安装。
因为要搭建hadoop集群,所以命名才用hadoop系列。
虚拟机才用2核4g的配置。
网路采用nat模式,可以访问外网,可以内网互相访问。
3、安装Ubuntu16.04
开启虚拟机后自动安装。
开机
Ubuntu安装完成。
4、配置系统
开启root账户
sudo passwd root
设置密码为hadoop
安装ssh服务
apt-get install openssh-server
设置允许超级管理员远程访问
# vi /etc/ssh/sshd_config
找到并用#注释掉这行:PermitRootLogin prohibit-password
新建一行 添加:PermitRootLogin yes
重启服务
# service ssh restart
设置网络桥接方式。
配置固定ip
/etc/network/interfaces
auto ens33
iface ens33inet static
address 192.168.1.151
gateway 192.168.1.1
netmask 255.255.255.0
配置dns
vi /etc/resolvconf/resolv.conf.d/base
nameserver 119.29.29.29
nameserver 182.254.116.116
配置hosts
/etc/hosts
#主机信息
192.168.1.151 hadoop01
192.168.1.152 hadoop02
192.168.1.153 hadoop03
192.168.1.154 hadoop04
192.168.1.155 hadoop05
配置hostname
/etc/hostname
hadoop01
修改最大线程数
vim /etc/security/limits.conf
root soft nofile 10240
root hard nofile 10240
root soft noproc 10240
root hard noproc 10240
设置时区
sudo tzselect
sudo cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
设置ntp
sudo apt-get install ntp
service ntp start
安装jdk1.8
自带安装
apt install openjdk-8-jdk-headless
修改etc/profile
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOMR}/bin:$PATH
配置生效
source /etc/profile
5、复制虚拟机
在虚拟机1上选择管理、克隆即可
更改每台复制机的ip地址和hostname
6、建立互信集群
生成密钥(主机全部执行一遍)
hadoop@hadoop01:~$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/hadoop/.ssh/id_rsa):
Created directory '/home/hadoop/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/hadoop/.ssh/id_rsa.
Your public key has been saved in /home/hadoop/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:3QfoHhnfu/GwcJ0zKNWIYYq7cCQko6vZjdAP47lR1cA hadoop@hadoop01
The key's randomart image is:
+---[RSA 2048]----+
| .. |
| Eo . |
| o .. . oo. |
| . +. .oo=ooo |
| . .. oS.=.ooo. |
| ... o .. ....o.|
|..= . o ....=+.|
|.= O o . .o *o|
|o *.o . o .|
+----[SHA256]-----+
传给互信主机
scp ~/.ssh/authorized_keys hadoop01:/root/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop02:/root/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop03:/root/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop04:/root/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop05:/root/.ssh/authorized_keys
本章结束!