[TOC]
org.apache.nutch.tools
Class FreeGenerator.FG
- java.lang.Object
- org.apache.hadoop.mapred.MapReduceBase
- org.apache.nutch.tools.FreeGenerator.FG
- All Implemented Interfaces:
- Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper
,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry>, org.apache.hadoop.mapred.Reducer - Enclosing class:
- FreeGenerator
public static class FreeGenerator.FG extends org.apache.hadoop.mapred.MapReduceBase implements org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.WritableComparable<?>,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry>, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,Generator.SelectorEntry,org.apache.hadoop.io.Text,CrawlDatum>
Constructor Summary
Constructors Constructor and Description FreeGenerator.FG()
Method Summary
Methods Modifier and Type Method and Description void
configure(org.apache.hadoop.mapred.JobConf job)
void
map(org.apache.hadoop.io.WritableComparable key,
org.apache.hadoop.io.Text value,
org.apache.hadoop.mapred.OutputCollector
void
reduce(org.apache.hadoop.io.Text key,
Iterator
-
Methods inherited from class org.apache.hadoop.mapred.MapReduceBase
close
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface java.io.Closeable
close
Constructor Detail
-
FreeGenerator.FG
public FreeGenerator.FG()
Method Detail
-
configure
public void configure(org.apache.hadoop.mapred.JobConf job)
- Specified by:
- <code>configure</code> in interface <code>org.apache.hadoop.mapred.JobConfigurable</code>
- Overrides:
- <code>configure</code> in class <code>org.apache.hadoop.mapred.MapReduceBase</code>
-
map
public void map(org.apache.hadoop.io.WritableComparable<?> key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output, org.apache.hadoop.mapred.Reporter reporter) throws IOException
- Specified by:
- <code>map</code> in interface <code>org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.writablecomparable<?>,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry></org.apache.hadoop.io.writablecomparable<?></code>
- Throws:
- <code>IOException</code>
-
reduce
public void reduce(org.apache.hadoop.io.Text key, Iterator<Generator.SelectorEntry> values, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output, org.apache.hadoop.mapred.Reporter reporter) throws IOException
- Specified by:
- <code>reduce</code> in interface <code>org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.text,generator.selectorentry,org.apache.hadoop.io.text,crawldatum></org.apache.hadoop.io.text,generator.selectorentry,org.apache.hadoop.io.text,crawldatum></code>
- Throws:
- <code>IOException</code>