Hadoop Pseudo-distributed

GitHub - gegurakzi/FastCampus_Hadoop at feature-malachai-pseudo

this project builds docker container with hadoop application using dockerfile. as the root directory of this project is /usr/lib directory in docker container, it is recommended to put some files in the right directory.

https://github.com/gegurakzi/FastCampus_Hadoop/tree/feature-malachai-pseudo

에러 상황

JVM을 통해 포트 9000에 열려있어야 할 Hadoop 프로세스가 닫혀있었음

> telnet localhost 9000
Trying localhost... 
telnet: Unable to connect to remote host: Connection refused
Bash
복사

해결:

hdfs-site.xml 파일 수정

<!--기존 hdfs-site.xml-->

<property>
    <name>dfs.namenode.name.dir</name>
    <value>$HADOOP_HOME/dfs/namenode</value>
</property>

<property>
    <name>dfs.datanode.data.dir</name>
    <value>$HADOOP_HOME/dfs/datanode</value>
</property>
XML
복사

<!--수정 hdfs-site.xml-->

<property>
    <name>dfs.namenode.name.dir</name>
    <value>/usr/lib/hadoop-3.3.4/dfs/namenode</value>
</property>

<property>
    <name>dfs.datanode.data.dir</name>
    <value>/usr/lib/hadoop-3.3.4/dfs/datanode</value>
</property>
XML
복사