CentOS7.5配置伪分布式环境

文章目录

• • • 1.提前安装JDK和Hadoop并配置好环境变量
    • 2.修改配置文件
    • 3.格式化NameNode
    • 4.启动Hadoop
    • 5.Web端查看HDFS信息

1.提前安装JDK和Hadoop并配置好环境变量

vim /etc/profile.d/my_env.sh

# JDK_HOME
export JAVA_HOME=/opt/module/jdk1.8.0_212
export CLASSPATH=$:CLASSPATH:$JAVA_HOME/lib/
export PATH=$PATH:$JAVA_HOME/bin

#HADOOP_HOME
export HADOOP_HOME=/opt/module/hadoop-3.1.3
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin

2.修改配置文件

core-site.xml

<configuration>
    
    <property>
        <name>fs.defaultFSname>
        <value>hdfs://hadoop112:9820value>
    property>
    
    <property>
        <name>hadoop.tmp.dirname>
        <value>/opt/module/hadoop-3.1.3/datavalue>
    property>

configuration>

hdfs-site.xml

<configuration>
    <property>
	<name>dfs.replicationname>
        <value>1value>
    property>
    
	<property>
        <name>dfs.namenode.http-addressname>
        <value>hadoop112:9870value>
    property>
    
    <property>
        <name>dfs.namenode.secondary.http-addressname>
        <value>hadoop112:9868value>
    property>
    <property>
        <name>dfs.namenode.name.dirname>
        <value>/opt/module/hadoop-3.1.3/data/dfs/namevalue>
    property>
    <property>
        <name>dfs.datanode.data.dirname>
        <value>/opt/module/hadoop-3.1.3/data/dfs/datavalue>
    property>
configuration>

yarn-site.xml（也可以不用改）

<configuration>

     <property>
        <name>yarn.nodemanager.aux-servicesname>
        <value>mapreduce_shufflevalue>
     property>
configuration>

3.格式化NameNode

hdfs namenode -format

如果格式化成功，会看到 has been successfully formatted 和 Exiting with status 0的提示信息。

4.启动Hadoop

./sbin/start-dfs.ah

5.Web端查看HDFS信息

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-cDgKUlzI-1652283250038)(web界面)]

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-duHgVZ9I-1652283250040)(DN信息)]

5.Web端查看HDFS信息

[外链图片转存中…(img-duHgVZ9I-1652283250040)]