Hadoop pseudo distributed configuration on CentOS -


i able configure hadoop on stand alone machine , try run pseudo distributed hadoop configuration have done configuration per this link.

  1. i able format name node
  2. but when fire bin/start-all.sh command, nodes not started properly.
  3. when went through log file, found following error.

namenode-hadoop2.log

java.io.ioexception: file /tmp/hadoop-root/mapred/system/jobtracker.info be
replicated 0 nodes, instead of 1 @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.getadditionalblock(fsnamesystem.java:1558)

jobtracker-hadoop2.log

2013-05-10 11:36:09,959 warn org.apache.hadoop.hdfs.dfsclient: datastreamer exception: org.apache.hadoop.ipc.remoteexception: java.io.ioexception: file /tmp/hadoop-root/mapred/system/jobtracker.info replicated 0 nodes, instead of 1

  1. i execute following command:

    bin/hadoop fs -put conf input

13/05/10 11:42:19 error hdfs.dfsclient: exception closing file /user/root/input/mapred-site.xml : org.apache.hadoop.ipc.remoteexception: java.io.ioexception: file /user/root/input/mapred-site.xml replicated 0 nodes, instead of 1

please tell me other configuration other this link.

thanks.

this error implies there problem datanode. make sure running , able talk namenode. make sure have enough space left on datanode's disk. check if reserved space dn (as set in dfs.datanode.du.reserved) greater remaining free space. may message due permissions, eg if jt can not create jobtracker.info on startup.

you may find link useful. have tried show complete procedure setup pseudo distributed cluster. see if help.


Comments

Post a Comment

Popular posts from this blog

linux - xterm copying to CLIPBOARD using copy-selection causes automatic updating of CLIPBOARD upon mouse selection -

i've tried various ways coerce xterm (versions 285 , 292) copy selection clipboard clipboard whenever press ctrl-shift-c. promising way far has been, in ~/.xresources, put this: xterm*vt100.translations: #override \ ctrl shift <keypress> c: copy-selection(clipboard) \n\ ctrl shift <keypress> v: insert-selection(clipboard) ctrl-shift-v works perfectly, copying has nuance... if restart xterm, highlighting text puts things in primary clipboard; expected, proper, default behavior. if hit ctrl-shift-c, copies current selection clipboard clipboard. the bug, however, if highlight text after first time pressed ctrl-shift-c, you'll see highlighting copies both primary and clipboard. cannot figure out how stop xterm updating clipboard upon selection... , doesn't make sense me in first place. i said, @ specific point in time, copy selection clipboard... yet starts updating automatically upon selection after doing once... anyone have workaround...
Read more

qt - Errors in generated MOC files for QT5 from cmake -

i generated moc files qt5 using set (cmake_automoc on) set(cmake_include_current_dir on) then add moc files src using set(src src/main.cpp src/video_widget_surface.cpp src/video_widget.cpp src/video_player.cpp #moc files moc/moc_video_player.cpp moc/moc_video_widget.cpp moc/moc_video_widget_surface.cpp finally add executable using add_executable(somegui ${src}) but errors in moc files saying : /other/workspace/perception/somestuff/moc/moc_video_widget.cpp:54:6: error: 'videowidget' has not been declared /other/workspace/perception/somestuff/moc/moc_video_widget.cpp:62:19: error: 'videowidget' has not been declared /other/workspace/perception/somestuff/moc/moc_video_widget.cpp:68:20: error: 'videowidget' has not been declared /other/workspace/perception/somestuff/moc/moc_video_widget.cpp:68:46: error: non-member function 'const qmetaobject* metaobject()' cannot have cv-qualifier /other/qt5.0.1/5.0.1/gcc_64/include/qtcore/qo...
Read more