[TOC]

org.apache.nutch.fetcher

Class Fetcher.InputFormat

  • java.lang.Object
    • org.apache.hadoop.mapred.FileInputFormat
    • org.apache.hadoop.mapred.SequenceFileInputFormat
      • org.apache.nutch.fetcher.Fetcher.InputFormat

    • All Implemented Interfaces:
    • org.apache.hadoop.mapred.InputFormat
    • Enclosing class:
    • Fetcher 
public static class Fetcher.InputFormat
extends org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Nested Class Summary

-

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

-

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Constructors Constructor and Description Fetcher.InputFormat()

Method Summary

Methods Modifier and Type Method and Description org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job, int nSplits) Don't split inputs, to keep things polite.

-

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

getRecordReader, listStatus 

-

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize 

-

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

-

Fetcher.InputFormat

public Fetcher.InputFormat()

Method Detail

-

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                              int nSplits)
                                                throws IOException

Don't split inputs, to keep things polite.

  - Specified by: 
  - <code>getSplits</code> in interface <code>org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.text,crawldatum></org.apache.hadoop.io.text,crawldatum></code> 
  - Overrides: 
  - <code>getSplits</code> in class <code>org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.text,crawldatum></org.apache.hadoop.io.text,crawldatum></code> 
  - Throws: 
  - <code>IOException</code>

Copyright © 2014 The Apache Software Foundation