weka.distributed.hadoop

Class WekaClassifierHadoopMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

weka.distributed.hadoop.WekaClassifierHadoopMapper

Direct Known Subclasses:

WekaFoldBasedClassifierHadoopMapper

public class WekaClassifierHadoopMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Mapper implementation for the WekaClassifierHadoopJob

Version:

$Revision: 12439 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CLASSIFIER_MAP_TASK_OPTIONS The key in the Configuration that the options for this task are associated with

Constructor Summary

Constructors

Constructor and Description
WekaClassifierHadoopMapper()

Method Summary

Modifier and Type	Method and Description
void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
void	map(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context)
static void	setClassIndex(java.lang.String[] options, Instances data, boolean defaultToLast) Helper method to set the class index in a supplied Instances object
static void	setClassIndex(java.lang.String classNameOrIndex, Instances data, boolean defaultToLast) Helper method for setting the class index in the supplied Instances object
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASSIFIER_MAP_TASK_OPTIONS

public static final java.lang.String CLASSIFIER_MAP_TASK_OPTIONS

The key in the Configuration that the options for this task are associated with

See Also:

Constant Field Values

Constructor Detail

WekaClassifierHadoopMapper

public WekaClassifierHadoopMapper()

Method Detail

setClassIndex

public static void setClassIndex(java.lang.String classNameOrIndex,
                                 Instances data,
                                 boolean defaultToLast)
                          throws java.lang.Exception

Helper method for setting the class index in the supplied Instances object

Parameters:

classNameOrIndex - name or index of the class attribute (may be the special 'first' or 'last' strings)

data - the data to set the class index in

defaultToLast - true if the data should have the last attribute set to the class if no class name/index is supplied

Throws:

java.lang.Exception - if a problem occurs

setClassIndex

public static void setClassIndex(java.lang.String[] options,
                                 Instances data,
                                 boolean defaultToLast)
                          throws java.lang.Exception

Helper method to set the class index in a supplied Instances object

Parameters:

options - an options string that potentially contains the -class option for specifying the index/name of the class attribute

data - the Instances to set the class index for

defaultToLast - true to set the last attribute as the class if no -class option is present in the options

Throws:

java.lang.Exception - if a problem occurs

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

map

public void map(org.apache.hadoop.io.LongWritable key,
                org.apache.hadoop.io.Text value,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws java.io.IOException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

cleanup

public void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
             throws java.io.IOException,
                    java.lang.InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

java.lang.InterruptedException