close

Finally, I find the target comparing dataset and I think our team should speed up to archive to goal. To define the problems and the whole process(geodata and route information and mapreduce hbase ...)
here is the result...


avain@avain-laptop:~/Desktop/EC2_trail/hadoop/src/contrib/ec2$ bin/hadoop-ec2 run
Starting cluster with AMI ami-461df82f
Waiting for instance i-34ab695d to start
........started as ec2-75-101-214-199.compute-1.amazonaws.com
Waiting for instance i-37ab695e to start
.started as ec2-67-202-44-153.compute-1.amazonaws.com
Appointing master
Master is ec2-75-101-214-199.compute-1.amazonaws.com. Please set up DNS so avain.selfip.net points to 75.101.214.199.
Press return to continue.

Waiting before trying to connect...

Asking master to say hello
Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
hello
Adjusting master hadoop-site.xml to minimize DNS lookups
Creating slaves file and copying to master
slaves                                        100%   42     0.0KB/s   00:00   
Copying private key to master
avain-hadoop                                  100% 1676     1.6KB/s   00:00   
Copying private key to slaves
Warning: Permanently added 'ec2-67-202-44-153.compute-1.amazonaws.com,67.202.44.153' (RSA) to the list of known hosts.
avain-hadoop                                  100% 1676     1.6KB/s   00:00   
Formatting new cluster's filesystem
08/04/24 11:22:10 INFO dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = ip-10-251-110-159.ec2.internal/10.251.110.159
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 0.16.1
STARTUP_MSG:   build = http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.16 -r 635123; compiled by 'hadoopqa' on Sun Mar  9 05:44:19 UTC 2008
************************************************************/
08/04/24 11:22:10 INFO fs.FSNamesystem: fsOwner=root,root,bin,daemon,sys,adm,disk,wheel
08/04/24 11:22:10 INFO fs.FSNamesystem: supergroup=supergroup
08/04/24 11:22:10 INFO fs.FSNamesystem: isPermissionEnabled=true
08/04/24 11:22:10 INFO dfs.Storage: Storage directory /mnt/hadoop/dfs/name has been successfully formatted.
08/04/24 11:22:10 INFO dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at ip-10-251-110-159.ec2.internal/10.251.110.159
************************************************************/
Starting cluster
rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
starting namenode, logging to /mnt/hadoop/logs/hadoop-root-namenode-ip-10-251-110-159.out
ec2-67-202-44-153.compute-1.amazonaws.com: Warning: Permanently added 'ec2-67-202-44-153.compute-1.amazonaws.com,10.251.43.243' (RSA) to the list of known hosts.
ec2-67-202-44-153.compute-1.amazonaws.com: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
ec2-67-202-44-153.compute-1.amazonaws.com: Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
ec2-67-202-44-153.compute-1.amazonaws.com: starting datanode, logging to /mnt/hadoop/logs/hadoop-root-datanode-ip-10-251-43-243.out
localhost: Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
localhost: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
localhost: starting secondarynamenode, logging to /mnt/hadoop/logs/hadoop-root-secondarynamenode-ip-10-251-110-159.out
rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
starting jobtracker, logging to /mnt/hadoop/logs/hadoop-root-jobtracker-ip-10-251-110-159.out
ec2-67-202-44-153.compute-1.amazonaws.com: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
ec2-67-202-44-153.compute-1.amazonaws.com: starting tasktracker, logging to /mnt/hadoop/logs/hadoop-root-tasktracker-ip-10-251-43-243.out
Finished - check progress at http://avain.selfip.net:50030/
Logging in to master avain.selfip.net.

         __|  __|_  )  Rev: 2
         _|  (     /
        ___|\___|___|

 Welcome to an EC2 Public Image
                       :-)
    Base

[root@ip-10-251-110-159 ~]#


arrow
arrow
    全站熱搜
    創作者介紹
    創作者 questioner 的頭像
    questioner

    questioner

    questioner 發表在 痞客邦 留言(0) 人氣()