Class FetcherOutputFormat

[TOC]

All Classes

Summary:
Nested |
Field |
Constr |
Method

Detail:
Field |
Constr |
Method

org.apache.nutch.fetcher

java.lang.Object
- org.apache.nutch.fetcher.FetcherOutputFormat

- All Implemented Interfaces:
- org.apache.hadoop.mapred.OutputFormat

public class FetcherOutputFormat
extends Object
implements org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.

Constructor Summary

Constructors Constructor and Description FetcherOutputFormat()

Method Summary

Methods Modifier and Type Method and Description void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job) org.apache.hadoop.mapred.RecordWriter getRecordWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs,
                    org.apache.hadoop.mapred.JobConf job)
                      throws IOException

  - Specified by: 
  - <code>checkOutputSpecs</code> in interface <code>org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.text,nutchwritable></org.apache.hadoop.io.text,nutchwritable></code> 
  - Throws: 
  - <code>IOException</code>       
-

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
                                                                                             org.apache.hadoop.mapred.JobConf job,
                                                                                             String name,
                                                                                             org.apache.hadoop.util.Progressable progress)
                                                                                               throws IOException

  - Specified by: 
  - <code>getRecordWriter</code> in interface <code>org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.text,nutchwritable></org.apache.hadoop.io.text,nutchwritable></code> 
  - Throws: 
  - <code>IOException</code>

All Classes

Summary:
Nested |
Field |
Constr |
Method

Detail:
Field |
Constr |
Method