Finally, I find the target comparing dataset and I think our team should speed up to archive to goal. To define the problems and the whole process(geodata and route information and mapreduce hbase ...)
here is the result...
avain@avain-laptop:~/Desktop/EC2_trail/hadoop/src/contrib/ec2$ bin/hadoop-ec2 run
Starting cluster with AMI ami-461df82f
Waiting for instance i-34ab695d to start
........started as ec2-75-101-214-199.compute-1.amazonaws.com
Waiting for instance i-37ab695e to start
.started as ec2-67-202-44-153.compute-1.amazonaws.com
Appointing master
Master is ec2-75-101-214-199.compute-1.amazonaws.com. Please set up DNS so avain.selfip.net points to 75.101.214.199.
Press return to continue.
Waiting before trying to connect...
Asking master to say hello
Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
hello
Adjusting master hadoop-site.xml to minimize DNS lookups
Creating slaves file and copying to master
slaves 100% 42 0.0KB/s 00:00
Copying private key to master
avain-hadoop 100% 1676 1.6KB/s 00:00
Copying private key to slaves
Warning: Permanently added 'ec2-67-202-44-153.compute-1.amazonaws.com,67.202.44.153' (RSA) to the list of known hosts.
avain-hadoop 100% 1676 1.6KB/s 00:00
Formatting new cluster's filesystem
08/04/24 11:22:10 INFO dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = ip-10-251-110-159.ec2.internal/10.251.110.159
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.16.1
STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.16 -r 635123; compiled by 'hadoopqa' on Sun Mar 9 05:44:19 UTC 2008
************************************************************/
08/04/24 11:22:10 INFO fs.FSNamesystem: fsOwner=root,root,bin,daemon,sys,adm,disk,wheel
08/04/24 11:22:10 INFO fs.FSNamesystem: supergroup=supergroup
08/04/24 11:22:10 INFO fs.FSNamesystem: isPermissionEnabled=true
08/04/24 11:22:10 INFO dfs.Storage: Storage directory /mnt/hadoop/dfs/name has been successfully formatted.
08/04/24 11:22:10 INFO dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at ip-10-251-110-159.ec2.internal/10.251.110.159
************************************************************/
Starting cluster
rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
starting namenode, logging to /mnt/hadoop/logs/hadoop-root-namenode-ip-10-251-110-159.out
ec2-67-202-44-153.compute-1.amazonaws.com: Warning: Permanently added 'ec2-67-202-44-153.compute-1.amazonaws.com,10.251.43.243' (RSA) to the list of known hosts.
ec2-67-202-44-153.compute-1.amazonaws.com: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
ec2-67-202-44-153.compute-1.amazonaws.com: Warning: Permanently added 'avain.selfip.net,75.101.214.199' (RSA) to the list of known hosts.
ec2-67-202-44-153.compute-1.amazonaws.com: starting datanode, logging to /mnt/hadoop/logs/hadoop-root-datanode-ip-10-251-43-243.out
localhost: Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
localhost: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
localhost: starting secondarynamenode, logging to /mnt/hadoop/logs/hadoop-root-secondarynamenode-ip-10-251-110-159.out
rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
starting jobtracker, logging to /mnt/hadoop/logs/hadoop-root-jobtracker-ip-10-251-110-159.out
ec2-67-202-44-153.compute-1.amazonaws.com: rsync from avain.selfip.net:/usr/local/hadoop-0.16.1
ec2-67-202-44-153.compute-1.amazonaws.com: starting tasktracker, logging to /mnt/hadoop/logs/hadoop-root-tasktracker-ip-10-251-43-243.out
Finished - check progress at http://avain.selfip.net:50030/
Logging in to master avain.selfip.net.
__| __|_ ) Rev: 2
_| ( /
___|\___|___|
Welcome to an EC2 Public Image
:-)
Base
[root@ip-10-251-110-159 ~]#