[TOC]

org.apache.nutch.protocol.http

Class Http

    • All Implemented Interfaces:
    • org.apache.hadoop.conf.Configurable, Pluggable, Protocol 
public class Http
extends HttpBase

Field Summary

Fields Modifier and Type Field and Description static org.slf4j.Logger LOG 

-

Fields inherited from class org.apache.nutch.protocol.http.api.HttpBase

accept, acceptLanguage, BUFFER_SIZE, maxContent, maxCrawlDelay, proxyHost, proxyPort, RESPONSE_TIME, responseTime, timeout, tlsPreferredCipherSuites, tlsPreferredProtocols, useHttp11, useProxy, userAgent 

-

Fields inherited from interface org.apache.nutch.protocol.Protocol

CHECK_BLOCKING, CHECK_ROBOTS, X_POINT_ID

Constructor Summary

Constructors Constructor and Description Http() Public default constructor.

Method Summary

Methods Modifier and Type Method and Description protected Response getResponse(URL url, CrawlDatum datum, boolean redirect) static void main(String[] args) void setConf(org.apache.hadoop.conf.Configuration conf) Set the Configuration object.

-

Methods inherited from class org.apache.nutch.protocol.http.api.HttpBase

getAccept, getAcceptLanguage, getConf, getMaxContent, getProtocolOutput, getProxyHost, getProxyPort, getRobotRules, getTimeout, getTlsPreferredCipherSuites, getTlsPreferredProtocols, getUseHttp11, getUserAgent, logConf, main, processDeflateEncoded, processGzipEncoded, useProxy 

-

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

-

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

-

Http

public Http()

Public default constructor.

Method Detail

-

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Set the Configuration object.

  - Specified by: 
  - <code>setConf</code> in interface <code>org.apache.hadoop.conf.Configurable</code> 
  - Overrides: 
  - <code>setConf</code> in class <code>HttpBase</code> 
  - Parameters:
  - <code>conf</code> -        
-

main

public static void main(String[] args)
                 throws Exception
  - Throws: 
  - <code>Exception</code>       
-

getResponse

protected Response getResponse(URL url,
                   CrawlDatum datum,
                   boolean redirect)
                        throws ProtocolException,
                               IOException
  - Specified by: 
  - <code>getResponse</code> in class <code>HttpBase</code> 
  - Throws: 
  - <code>ProtocolException</code> 
  - <code>IOException</code>

Copyright © 2014 The Apache Software Foundation