当我尝试运行hadoop时完成hadoop安装后,我发现(通过jps)namenode没有运行。 我在日志文件中search,发现一个exception是“目录/ hadoop / tmp / dfs /名称处于不一致的状态:存储目录不存在或不可访问”。 。 所以我通过sudo mkdir -p / hadoop / tmp / dfs / name在/ hadoop / tmp / dfs / name中创build了i目录,并赋予这个完整的权限。 现在重新启动hadoop后,我看到namenode仍然没有发现,我发现这个exception“dFSnamesystem initialization Failed.java.io.IOException:nameNode未格式化”。 我已经格式化了namenode“{hadoop-dir} / bin hadoop namenode -format”,它的格式很好,但是namenode日志中的exception仍然存在。 这里我的namenode日志在下面给出
2012-04-11 13:19:09,174 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting nameNode STARTUP_MSG: host = hbase.com.com/192.168.15.20 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.205.0 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205 -r 1179940; compiled by 'hortonfo' on Fri Oct 7 06:20:32 UTC 2011 ************************************************************/ 2012-04-11 13:19:09,899 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded propertIEs from hadoop-metrics2.propertIEs 2012-04-11 13:19:09,959 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source MetriCSSystem,sub=Stats registered. 2012-04-11 13:19:09,965 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Scheduled snapshot period at 10 second(s). 2012-04-11 13:19:09,965 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: nameNode metrics system started 2012-04-11 13:19:10,443 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source ugi registered. 2012-04-11 13:19:10,469 WARN org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Source name ugi already exists! 2012-04-11 13:19:10,490 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source jvm registered. 2012-04-11 13:19:10,492 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source nameNode registered. 2012-04-11 13:19:10,666 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 32-bit 2012-04-11 13:19:10,666 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 19.33375 MB 2012-04-11 13:19:10,666 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^22 = 4194304 entrIEs 2012-04-11 13:19:10,666 INFO org.apache.hadoop.hdfs.util.GSet: recommended=4194304,actual=4194304 2012-04-11 13:19:11,005 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: fsOwner=com 2012-04-11 13:19:11,006 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: supergroup=supergroup 2012-04-11 13:19:11,006 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isPermissionEnabled=false 2012-04-11 13:19:11,025 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: dfs.block.invalIDate.limit=100 2012-04-11 13:19:11,026 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isAccesstokenEnabled=false accessKeyUpdateInterval=0 min(s),accesstokenlifetime=0 min(s) 2012-04-11 13:19:11,086 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: Registered FSnamesystemStateMBean and nameNodeMXBean 2012-04-11 13:19:11,174 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: Caching file names occuring more than 10 times 2012-04-11 13:19:11,211 ERROR org.apache.hadoop.hdfs.server.namenode.FSnamesystem: FSnamesystem initialization Failed. java.io.IOException: nameNode is not formatted. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:315) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:19:11,212 ERROR org.apache.hadoop.hdfs.server.namenode.nameNode: java.io.IOException: nameNode is not formatted. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:315) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:19:11,217 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down nameNode at hbase.com.com/192.168.15.20 ************************************************************/ 2012-04-11 13:28:38,247 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting nameNode STARTUP_MSG: host = hbase.com.com/192.168.15.20 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.205.0 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205 -r 1179940; compiled by 'hortonfo' on Fri Oct 7 06:20:32 UTC 2011 ************************************************************/ 2012-04-11 13:28:39,037 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded propertIEs from hadoop-metrics2.propertIEs 2012-04-11 13:28:39,101 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source MetriCSSystem,sub=Stats registered. 2012-04-11 13:28:39,107 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Scheduled snapshot period at 10 second(s). 2012-04-11 13:28:39,107 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: nameNode metrics system started 2012-04-11 13:28:39,626 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source ugi registered. 2012-04-11 13:28:39,643 WARN org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Source name ugi already exists! 2012-04-11 13:28:39,667 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source jvm registered. 2012-04-11 13:28:39,672 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source nameNode registered. 2012-04-11 13:28:39,842 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 32-bit 2012-04-11 13:28:39,844 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 19.33375 MB 2012-04-11 13:28:39,844 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^22 = 4194304 entrIEs 2012-04-11 13:28:39,844 INFO org.apache.hadoop.hdfs.util.GSet: recommended=4194304,actual=4194304 2012-04-11 13:28:40,176 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: fsOwner=com 2012-04-11 13:28:40,183 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: supergroup=supergroup 2012-04-11 13:28:40,184 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isPermissionEnabled=false 2012-04-11 13:28:40,210 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: dfs.block.invalIDate.limit=100 2012-04-11 13:28:40,211 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isAccesstokenEnabled=false accessKeyUpdateInterval=0 min(s),accesstokenlifetime=0 min(s) 2012-04-11 13:28:40,281 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: Registered FSnamesystemStateMBean and nameNodeMXBean 2012-04-11 13:28:40,393 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: Caching file names occuring more than 10 times 2012-04-11 13:28:40,414 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /hadoop/tmp/dfs/name does not exist. 2012-04-11 13:28:40,417 ERROR org.apache.hadoop.hdfs.server.namenode.FSnamesystem: FSnamesystem initialization Failed. org.apache.hadoop.hdfs.server.common.InconsistentFsstateException: Directory /hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:288) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:28:40,429 ERROR org.apache.hadoop.hdfs.server.namenode.nameNode: org.apache.hadoop.hdfs.server.common.InconsistentFsstateException: Directory /hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:288) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:28:40,430 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down nameNode at hbase.com.com/192.168.15.20 ************************************************************/ 2012-04-11 13:32:59,596 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting nameNode STARTUP_MSG: host = hbase.com.com/192.168.15.20 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.205.0 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205 -r 1179940; compiled by 'hortonfo' on Fri Oct 7 06:20:32 UTC 2011 ************************************************************/ 2012-04-11 13:33:00,423 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded propertIEs from hadoop-metrics2.propertIEs 2012-04-11 13:33:00,489 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source MetriCSSystem,sub=Stats registered. 2012-04-11 13:33:00,495 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Scheduled snapshot period at 10 second(s). 2012-04-11 13:33:00,496 INFO org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: nameNode metrics system started 2012-04-11 13:33:00,973 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source ugi registered. 2012-04-11 13:33:00,998 WARN org.apache.hadoop.metrics2.impl.MetriCSSystemImpl: Source name ugi already exists! 2012-04-11 13:33:01,018 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source jvm registered. 2012-04-11 13:33:01,023 INFO org.apache.hadoop.metrics2.impl.MetriCSSourceAdapter: MBean for source nameNode registered. 2012-04-11 13:33:01,167 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 32-bit 2012-04-11 13:33:01,167 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 19.33375 MB 2012-04-11 13:33:01,167 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^22 = 4194304 entrIEs 2012-04-11 13:33:01,167 INFO org.apache.hadoop.hdfs.util.GSet: recommended=4194304,actual=4194304 2012-04-11 13:33:01,471 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: fsOwner=com 2012-04-11 13:33:01,474 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: supergroup=supergroup 2012-04-11 13:33:01,474 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isPermissionEnabled=false 2012-04-11 13:33:01,493 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: dfs.block.invalIDate.limit=100 2012-04-11 13:33:01,497 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: isAccesstokenEnabled=false accessKeyUpdateInterval=0 min(s),accesstokenlifetime=0 min(s) 2012-04-11 13:33:01,590 INFO org.apache.hadoop.hdfs.server.namenode.FSnamesystem: Registered FSnamesystemStateMBean and nameNodeMXBean 2012-04-11 13:33:01,748 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: Caching file names occuring more than 10 times 2012-04-11 13:33:01,776 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /hadoop/tmp/dfs/name does not exist. 2012-04-11 13:33:01,787 ERROR org.apache.hadoop.hdfs.server.namenode.FSnamesystem: FSnamesystem initialization Failed. org.apache.hadoop.hdfs.server.common.InconsistentFsstateException: Directory /hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:288) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:33:01,788 ERROR org.apache.hadoop.hdfs.server.namenode.nameNode: org.apache.hadoop.hdfs.server.common.InconsistentFsstateException: Directory /hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:288) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:97) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.initialize(FSnamesystem.java:384) at org.apache.hadoop.hdfs.server.namenode.FSnamesystem.<init>(FSnamesystem.java:358) at org.apache.hadoop.hdfs.server.namenode.nameNode.initialize(nameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.nameNode.<init>(nameNode.java:497) at org.apache.hadoop.hdfs.server.namenode.nameNode.createnameNode(nameNode.java:1268) at org.apache.hadoop.hdfs.server.namenode.nameNode.main(nameNode.java:1277) 2012-04-11 13:33:01,793 INFO org.apache.hadoop.hdfs.server.namenode.nameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down nameNode at hbase.com.com/192.168.15.20 ************************************************************/
这很简单 – 格式化你的namenode
mcbatyuk:hadoop bam$ bin/hadoop namenode -format Warning: $HADOOP_HOME is deprecated. 12/04/11 21:04:55 INFO namenode.nameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting nameNode STARTUP_MSG: host = mcbatyuk.local/192.168.10.102 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 1.0.0 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r 1214675; compiled by 'hortonfo' on Thu Dec 15 16:36:35 UTC 2011 ************************************************************/ Re-format filesystem in /Users/bam/hadoop/name ? (Y or N) Y Format aborted in /Users/bam/hadoop/name 12/04/11 21:04:57 INFO namenode.nameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down nameNode at mcbatyuk.local/192.168.10.102 ************************************************************/`
总结以上是内存溢出为你收集整理的Namenode没有运行全部内容,希望文章能够帮你解决Namenode没有运行所遇到的程序开发问题。
如果觉得内存溢出网站内容还不错,欢迎将内存溢出网站推荐给程序员好友。
欢迎分享,转载请注明来源:内存溢出
评论列表(0条)