[TOC]

org.apache.nutch.tools

Class FreeGenerator

  • java.lang.Object
    • org.apache.hadoop.conf.Configured
    • org.apache.nutch.tools.FreeGenerator
    • All Implemented Interfaces:
    • org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool 
public class FreeGenerator
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

This tool generates fetchlists (segments to be fetched) from plain text files containing one URL per line. It's useful when arbitrary URL-s need to be fetched without adding them first to the CrawlDb, or during testing.

Nested Class Summary

Nested Classes Modifier and Type Class and Description static class FreeGenerator.FG

Constructor Summary

Constructors Constructor and Description FreeGenerator()

Method Summary

Methods Modifier and Type Method and Description static void main(String[] args) int run(String[] args) 

-

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf 

-

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait 

-

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

-

FreeGenerator

public FreeGenerator()

Method Detail

-

run

public int run(String[] args)
        throws Exception
  - Specified by: 
  - <code>run</code> in interface <code>org.apache.hadoop.util.Tool</code> 
  - Throws: 
  - <code>Exception</code>       
-

main

public static void main(String[] args)
                 throws Exception
  - Throws: 
  - <code>Exception</code>

Copyright © 2014 The Apache Software Foundation