[TOC]
org.apache.nutch.crawl
Class CrawlDbMerger.Merger
- java.lang.Object
- org.apache.hadoop.mapred.MapReduceBase
- org.apache.nutch.crawl.CrawlDbMerger.Merger
- All Implemented Interfaces:
- Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer
- Enclosing class:
- CrawlDbMerger
public static class CrawlDbMerger.Merger extends org.apache.hadoop.mapred.MapReduceBase implements org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,CrawlDatum,org.apache.hadoop.io.Text,CrawlDatum>
Constructor Summary
Constructors Constructor and Description CrawlDbMerger.Merger()
Method Summary
Methods Modifier and Type Method and Description void close() void configure(org.apache.hadoop.mapred.JobConf conf) void reduce(org.apache.hadoop.io.Text key,
Iterator
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Constructor Detail
-
CrawlDbMerger.Merger
public CrawlDbMerger.Merger()
Method Detail
-
close
public void close()
throws IOException
- Specified by:
- <code>close</code> in interface <code>Closeable</code>
- Specified by:
- <code>close</code> in interface <code>AutoCloseable</code>
- Overrides:
- <code>close</code> in class <code>org.apache.hadoop.mapred.MapReduceBase</code>
- Throws:
- <code>IOException</code>
-
configure
public void configure(org.apache.hadoop.mapred.JobConf conf)
- Specified by:
- <code>configure</code> in interface <code>org.apache.hadoop.mapred.JobConfigurable</code>
- Overrides:
- <code>configure</code> in class <code>org.apache.hadoop.mapred.MapReduceBase</code>
-
reduce
public void reduce(org.apache.hadoop.io.Text key,
Iterator<CrawlDatum> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output,
org.apache.hadoop.mapred.Reporter reporter)
throws IOException
- Specified by:
- <code>reduce</code> in interface <code>org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.text,crawldatum,org.apache.hadoop.io.text,crawldatum></org.apache.hadoop.io.text,crawldatum,org.apache.hadoop.io.text,crawldatum></code>
- Throws:
- <code>IOException</code>
