- Detail:
- Field |
- Constr |
- Method
org.apache.nutch.util
Class NutchJob
- java.lang.Object
- org.apache.hadoop.conf.Configuration
- org.apache.hadoop.mapred.JobConf
- org.apache.nutch.util.NutchJob
public class NutchJob extends org.apache.hadoop.mapred.JobConf
A JobConf
for Nutch jobs.
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration
org.apache.hadoop.conf.Configuration.IntegerRanges
Field Summary
-
Fields inherited from class org.apache.hadoop.mapred.JobConf
DEFAULT_MAPRED_TASK_JAVA_OPTS, DEFAULT_MAPREDUCE_RECOVER_JOB, DEFAULT_QUEUE_NAME, DISABLED_MEMORY_LIMIT, MAPRED_JOB_MAP_MEMORY_MB_PROPERTY, MAPRED_JOB_REDUCE_MEMORY_MB_PROPERTY, MAPRED_LOCAL_DIR_PROPERTY, MAPRED_MAP_TASK_ENV, MAPRED_MAP_TASK_JAVA_OPTS, MAPRED_MAP_TASK_ULIMIT, MAPRED_REDUCE_TASK_ENV, MAPRED_REDUCE_TASK_JAVA_OPTS, MAPRED_REDUCE_TASK_ULIMIT, MAPRED_TASK_DEFAULT_MAXVMEM_PROPERTY, MAPRED_TASK_ENV, MAPRED_TASK_JAVA_OPTS, MAPRED_TASK_MAXPMEM_PROPERTY, MAPRED_TASK_MAXVMEM_PROPERTY, MAPRED_TASK_ULIMIT, MAPREDUCE_RECOVER_JOB, UPPER_LIMIT_ON_TASK_VMEM_PROPERTY, WORKFLOW_ADJACENCY_PREFIX_PATTERN, WORKFLOW_ADJACENCY_PREFIX_STRING, WORKFLOW_ID, WORKFLOW_NAME, WORKFLOW_NODE_NAME, WORKFLOW_TAGS
Constructor Summary
Constructors Constructor and Description NutchJob(org.apache.hadoop.conf.Configuration conf)
Method Summary
-
Methods inherited from class org.apache.hadoop.mapred.JobConf
deleteLocalFiles, deleteLocalFiles, getCombinerClass, getCompressMapOutput, getCredentials, getInputFormat, getJar, getJobEndNotificationURI, getJobLocalDir, getJobName, getJobPriority, getKeepFailedTaskFiles, getKeepTaskFilesPattern, getKeyFieldComparatorOption, getKeyFieldPartitionerOption, getLocalDirs, getLocalPath, getMapDebugScript, getMapOutputCompressorClass, getMapOutputKeyClass, getMapOutputValueClass, getMapperClass, getMapRunnerClass, getMapSpeculativeExecution, getMaxMapAttempts, getMaxMapTaskFailuresPercent, getMaxPhysicalMemoryForTask, getMaxReduceAttempts, getMaxReduceTaskFailuresPercent, getMaxTaskFailuresPerTracker, getMaxVirtualMemoryForTask, getMemoryForMapTask, getMemoryForReduceTask, getNumMapTasks, getNumReduceTasks, getNumTasksToExecutePerJvm, getOutputCommitter, getOutputFormat, getOutputKeyClass, getOutputKeyComparator, getOutputValueClass, getOutputValueGroupingComparator, getPartitionerClass, getProfileEnabled, getProfileParams, getProfileTaskRange, getQueueName, getReduceDebugScript, getReducerClass, getReduceSpeculativeExecution, getSessionId, getSpeculativeExecution, getUseNewMapper, getUseNewReducer, getUser, getWorkingDirectory, normalizeMemoryConfigValue, setCombinerClass, setCompressMapOutput, setInputFormat, setJar, setJarByClass, setJobEndNotificationURI, setJobName, setJobPriority, setKeepFailedTaskFiles, setKeepTaskFilesPattern, setKeyFieldComparatorOptions, setKeyFieldPartitionerOptions, setMapDebugScript, setMapOutputCompressorClass, setMapOutputKeyClass, setMapOutputValueClass, setMapperClass, setMapRunnerClass, setMapSpeculativeExecution, setMaxMapAttempts, setMaxMapTaskFailuresPercent, setMaxPhysicalMemoryForTask, setMaxReduceAttempts, setMaxReduceTaskFailuresPercent, setMaxTaskFailuresPerTracker, setMaxVirtualMemoryForTask, setMemoryForMapTask, setMemoryForReduceTask, setNumMapTasks, setNumReduceTasks, setNumTasksToExecutePerJvm, setOutputCommitter, setOutputFormat, setOutputKeyClass, setOutputKeyComparatorClass, setOutputValueClass, setOutputValueGroupingComparator, setPartitionerClass, setProfileEnabled, setProfileParams, setProfileTaskRange, setQueueName, setReduceDebugScript, setReducerClass, setReduceSpeculativeExecution, setSessionId, setSpeculativeExecution, setUseNewMapper, setUseNewReducer, setUser, setWorkingDirectory
-
Methods inherited from class org.apache.hadoop.conf.Configuration
addDefaultResource, addResource, addResource, addResource, addResource, clear, dumpConfiguration, get, get, getBoolean, getClass, getClass, getClassByName, getClasses, getClassLoader, getConfResourceAsInputStream, getConfResourceAsReader, getEnum, getFile, getFloat, getInstances, getInt, getLocalPath, getLong, getRange, getRaw, getResource, getStringCollection, getStrings, getStrings, getValByRegex, iterator, main, readFields, reloadConfiguration, set, setBoolean, setBooleanIfUnset, setClass, setClassLoader, setEnum, setFloat, setIfUnset, setInt, setLong, setQuietMode, setStrings, size, toString, unset, write, writeXml, writeXml
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
Constructor Detail
-
NutchJob
public NutchJob(org.apache.hadoop.conf.Configuration conf)
- Detail:
- Field |
- Constr |
- Method