我爱编程

HA 模式下 Hadoop集群Start和Stop流程

2018-04-27  本文已影响119人  Plokmijn

假设我们有3台虚拟机,主机名分别是master、slave1和slave2。
这3台虚拟机的Hadoop的HA集群部署如下:

master slave1 slave2
Zookeeper Zookeeper Zookeeper
JournalNode JournalNode JournalNode
NodeManager NodeManager NodeManager
DataNode DataNode DataNode
NameNode NameNode none
zkfc zkfc none
ResourceManager none ResourceManager
集群的启动流程如下:
[root@master ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@slave1 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@slave2 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@master ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Mode: follower
[root@slave1 ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Mode: leader
[root@slave2 ~]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper-3.4.11/bin/../conf/zoo.cfg
Mode: follower
[root@master ~]# start-dfs.sh
[root@master ~]# start-yarn.sh
[root@slave2 ~]# yarn-daemon.sh start resourcemanager
[root@master ~]# jps
35872 DataNode
28868 QuorumPeerMain
37799 NodeManager
36216 JournalNode
35641 NameNode
36521 DFSZKFailoverController
37625 ResourceManager
40138 Jps
[root@slave1 ~]# jps
35266 JournalNode
35028 DataNode
28213 QuorumPeerMain
38773 Jps
36650 NodeManager
34843 NameNode
35517 DFSZKFailoverController
[root@slave2 ~]# jps
28689 QuorumPeerMain
38953 Jps
36874 NodeManager
38812 ResourceManager
35614 JournalNode
35343 DataNode

如果某一个NameNode进程挂掉了的话,就使用如下命令单独启动一个NameNode:
hadoop-daemon.sh start namenode

下面是停止Hadoop的HA集群的流程:
[root@master ~]# stop-dfs.sh
[root@master ~]# stop-yarn.sh
[root@slave2 ~]# yarn-daemon.sh stop resourcemanager
[root@master ~]# zkServer.sh stop
[root@slave1 ~]# zkServer.sh stop
[root@slave2 ~]# zkServer.sh stop
[root@master ~]# jps
45307 Jps
[root@slave1]# jps
40713 Jps
[root@slave2 ~]# jps
42108 Jps

参考

HA 模式下的 Hadoop+ZooKeeper+HBase 启动顺序

上一篇下一篇

猜你喜欢

热点阅读