org.apache.hadoop.examples.terasort
Class TeraValidate
java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.hadoop.examples.terasort.TeraValidate
- All Implemented Interfaces:
- org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool
public class TeraValidate
- extends org.apache.hadoop.conf.Configured
- implements org.apache.hadoop.util.Tool
Generate 1 mapper per a file that checks to make sure the keys
are sorted within each file. The mapper also generates
"$file:begin", first key and "$file:end", last key. The reduce verifies that
all of the start/end items are in order.
Any output from the reduce is problem report.
To run the program:
bin/hadoop jar hadoop-*-examples.jar teravalidate out-dir report-dir
If there is any output, something is wrong and the output of the reduce
will have the problem report.
Methods inherited from class org.apache.hadoop.conf.Configured |
getConf, setConf |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.hadoop.conf.Configurable |
getConf, setConf |
TeraValidate
public TeraValidate()
run
public int run(String[] args)
throws Exception
- Specified by:
run
in interface org.apache.hadoop.util.Tool
- Throws:
Exception
main
public static void main(String[] args)
throws Exception
- Parameters:
args
-
- Throws:
Exception
Copyright © 2009 The Apache Software Foundation