- Hive搭建 ha高可用集群
- 第一步 修改hdfs-site.xml
- 第二步 修改core-site.xml
- 第三步 修改mapred-site.xml
- 第四步 修改yarn-site.xml
第二步 修改core-site.xmldfs.nameservices rootcloud dfs.ha.namenodes .rootcloud nn1,nn2 dfs.namenode.rpc-address.cluster1.nn1 hadoop01:8020 dfs.namenode.servicerpc-address.rootcloud.nn1 hadoop01:8021 dfs.namenode.http-address.cluster1.nn1 hadoop01:50070 dfs.namenode.rpc-address.cluster1.nn2 hadoop02:8020 dfs.namenode.servicerpc-address.rootcloud.nn1 hadoop02:8021 dfs.namenode.http-address.cluster1.nn2 hadoop02:50070 dfs.namenode.shared.edits.dir qjournal:// hadoop01:8485; hadoop02:8485; hadoop03:8485 /rootcloud-journal-new dfs.journalnode.edits.dir /data/rootcloud/hadoop-3.2.2/journal dfs.ha.automatic-failover.enabled shell(/bin/true) dfs.client.failover.proxy.provider.rootcloud org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods shell(/bin/true) dfs.ha.fencing.ssh.private-key-files /root/.ssh/id_rsa dfs.ha.fencing.ssh.connect-timeout 50000
第三步 修改mapred-site.xmlfs.defaultFS hdfs:// rootcloud hadoop.tmp.dir /data/app/hadoop-3.2.2/etc/hadoop/tmp ha.zookeeper.quorum hadoop01:2181,hadoop02:2181,hadoop03:2181
第四步 修改yarn-site.xmlmapreduce.framework.name yarn
yarn.resourcemanager.ha.enabled true yarn.resourcemanager.cluster-id yarn-ha yarn.resourcemanager.ha.rm-ids rm1,rm2 yarn.resourcemanager.hostname.rm1 hadoop01 yarn.resourcemanager.hostname.rm2 hadoop02 yarn.resourcemanager.zk-address hadoop01:2181,hadoop02:2181,hadoop03:2181 yarn.nodemanager.aux-services mapreduce_shuffle
欢迎分享,转载请注明来源:内存溢出
评论列表(0条)