[TOC]

org.apache.nutch.crawl

Class CrawlDbMerger.Merger

  • java.lang.Object
    • org.apache.hadoop.mapred.MapReduceBase
    • org.apache.nutch.crawl.CrawlDbMerger.Merger

public static class CrawlDbMerger.Merger
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,CrawlDatum,org.apache.hadoop.io.Text,CrawlDatum>

Constructor Summary

Constructors Constructor and Description CrawlDbMerger.Merger()

Method Summary

Methods Modifier and Type Method and Description void close() void configure(org.apache.hadoop.mapred.JobConf conf) void reduce(org.apache.hadoop.io.Text key, Iterator values, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)

-    

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

-  

CrawlDbMerger.Merger

public CrawlDbMerger.Merger()

Method Detail

-  

close

public void close()
           throws IOException
  - Specified by: 
  - <code>close</code> in interface <code>Closeable</code> 
  - Specified by: 
  - <code>close</code> in interface <code>AutoCloseable</code> 
  - Overrides: 
  - <code>close</code> in class <code>org.apache.hadoop.mapred.MapReduceBase</code> 
  - Throws: 
  - <code>IOException</code>       
-  

configure

public void configure(org.apache.hadoop.mapred.JobConf conf)
  - Specified by: 
  - <code>configure</code> in interface <code>org.apache.hadoop.mapred.JobConfigurable</code> 
  - Overrides: 
  - <code>configure</code> in class <code>org.apache.hadoop.mapred.MapReduceBase</code>        
-  

reduce

public void reduce(org.apache.hadoop.io.Text key,
          Iterator<CrawlDatum> values,
          org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output,
          org.apache.hadoop.mapred.Reporter reporter)
            throws IOException
  - Specified by: 
  - <code>reduce</code> in interface <code>org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.text,crawldatum,org.apache.hadoop.io.text,crawldatum></org.apache.hadoop.io.text,crawldatum,org.apache.hadoop.io.text,crawldatum></code> 
  - Throws: 
  - <code>IOException</code>      

Copyright © 2014 The Apache Software Foundation