weka.distributed.hadoop

Class WekaScoringHadoopJob

java.lang.Object

distributed.core.DistributedJob

weka.distributed.hadoop.HadoopJob

weka.distributed.hadoop.WekaScoringHadoopJob

All Implemented Interfaces:

java.io.Serializable, CommandlineRunnable, EnvironmentHandler, OptionHandler

public class WekaScoringHadoopJob
extends HadoopJob
implements CommandlineRunnable

Hadoop job for scoring new data using an existing Weka classifier or clusterer.

Version:

$Revision: 10749 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class distributed.core.DistributedJob

distributed.core.DistributedJob.JobStatus

Field Summary

Fields inherited from class weka.distributed.hadoop.HadoopJob

COLT_JAR, DISTRIBUTED_WEKA_BASE_JAR, DISTRIBUTED_WEKA_HADOOP_JAR, JCOMMON_JAR, JFREECHART_JAR, LA4J_JAR, OPEN_CSV_JAR

Fields inherited from class distributed.core.DistributedJob

WEKA_ADDITIONAL_PACKAGES_KEY

Constructor Summary

Constructors

Constructor and Description
WekaScoringHadoopJob() Constructor

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	columnsToOutputInScoredDataTipText() Tip text for this property
java.lang.String	getColumnsToOutputInScoredData() Get the columns to output (as a comma-separated list of indexes) in the scored data.
java.lang.String	getCSVMapTaskOptions() Get the options for the ARFF header job
java.lang.String[]	getJobOptionsOnly()
java.lang.String	getModelPath() Get the path (HDFS or local) to the model to use for scoring.
java.lang.String[]	getOptions()
java.lang.String	globalInfo() Help information for this job
java.util.Enumeration<Option>	listOptions()
static void	main(java.lang.String[] args)
java.lang.String	modelPathTipText() Tip text for this property
void	run(java.lang.Object toRun, java.lang.String[] args)
boolean	runJob()
void	setColumnsToOutputInScoredData(java.lang.String cols) Set the columns to output (as a comma-separated list of indexes) in the scored data.
void	setCSVMapTaskOptions(java.lang.String opts) Set the options for the ARFF header job
void	setModelPath(java.lang.String modelPath) Set the path (HDFS or local) to the model to use for scoring.
void	setOptions(java.lang.String[] options)

Methods inherited from class weka.distributed.hadoop.HadoopJob

additionalWekaPackagesTipText, cleanOutputDirectory, deubgTipText, getAdditionalWekaPackages, getBaseOptionsOnly, getDebug, getLoggingInterval, getMapNumber, getMapReduceJobConfig, getMapReduceNumber, getPathToWekaJar, getReduceNumber, loggingIntervalTipText, pathToWekaJarTipText, setAdditionalWekaPackages, setDebug, setLoggingInterval, setMapReduceJobConfig, setPathToWekaJar

Methods inherited from class distributed.core.DistributedJob

environmentSubstitute, getAdditionalWekaPackageNames, getJobName, getJobStatus, getLog, makeOptionsStr, parseInstance, setEnvironment, setJobDescription, setJobName, setJobStatus, setLog, setStatusMessagePrefix, stopJob

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WekaScoringHadoopJob

public WekaScoringHadoopJob()

Constructor

Method Detail

globalInfo

public java.lang.String globalInfo()

Help information for this job

Returns:

help information for this job

modelPathTipText

public java.lang.String modelPathTipText()

Tip text for this property

Returns:

the tip text for this property

setModelPath

public void setModelPath(java.lang.String modelPath)

Set the path (HDFS or local) to the model to use for scoring.

Parameters:

modelPath - the path to the model to use for scoring

getModelPath

public java.lang.String getModelPath()

Get the path (HDFS or local) to the model to use for scoring.

Returns:

the path to the model to use for scoring

columnsToOutputInScoredDataTipText

public java.lang.String columnsToOutputInScoredDataTipText()

Tip text for this property

Returns:

the tip text for this property

setColumnsToOutputInScoredData

public void setColumnsToOutputInScoredData(java.lang.String cols)

Set the columns to output (as a comma-separated list of indexes) in the scored data. 'first' and 'last' may be used as well (e.g. 1,2,10-last).

Parameters:

cols - the columns to output in the scored data

getColumnsToOutputInScoredData

public java.lang.String getColumnsToOutputInScoredData()

Get the columns to output (as a comma-separated list of indexes) in the scored data. 'first' and 'last' may be used as well (e.g. 1,2,10-last).

Returns:

the columns to output in the scored data

setCSVMapTaskOptions

public void setCSVMapTaskOptions(java.lang.String opts)

Set the options for the ARFF header job

Parameters:

opts - options for the ARFF header job

getCSVMapTaskOptions

public java.lang.String getCSVMapTaskOptions()

Get the options for the ARFF header job

Returns:

the options for the ARFF header job

listOptions

public java.util.Enumeration<Option> listOptions()

Specified by:

listOptions in interface OptionHandler

Overrides:

listOptions in class HadoopJob

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Specified by:

setOptions in interface OptionHandler

Overrides:

setOptions in class HadoopJob

Throws:

java.lang.Exception

getOptions

public java.lang.String[] getOptions()

Specified by:

getOptions in interface OptionHandler

Overrides:

getOptions in class HadoopJob

getJobOptionsOnly

public java.lang.String[] getJobOptionsOnly()

runJob

public boolean runJob()
               throws weka.distributed.DistributedWekaException

Specified by:

runJob in class distributed.core.DistributedJob

Throws:

weka.distributed.DistributedWekaException

main

public static void main(java.lang.String[] args)

run

public void run(java.lang.Object toRun,
       java.lang.String[] args)
         throws java.lang.IllegalArgumentException

Specified by:

run in interface CommandlineRunnable

Throws:

java.lang.IllegalArgumentException