weka.distributed.hadoop

Class DenormalizeHadoopReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

weka.distributed.hadoop.DenormalizeHadoopReducer

public class DenormalizeHadoopReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	AUX_ITEM_STATS_SUBDIR_NAME Default name of the subdirectory in which to store header and stats
static java.lang.String	AUX_ITEM_STATS_WRITE_PATH Full path at which to store header, item means and counts for later use
static java.lang.String	DENORMALIZED_HEADER_FILE_NAME Name of the file to output the denormalized header to * public static final
static java.lang.String	ITEM_COUNTS_FILE_NAME The name of the file to output the serialized array of item counts to
static java.lang.String	ITEM_MEANS_FILE_NAME The name of the file to output the serialized array of item means to

Constructor Summary

Constructors

Constructor and Description
DenormalizeHadoopReducer()

Method Summary

Methods

Modifier and Type	Method and Description
void	cleanup(org.apache.hadoop.mapreduce.Reducer.Context context)
void	reduce(org.apache.hadoop.io.LongWritable key, java.lang.Iterable<org.apache.hadoop.io.Text> values, org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

AUX_ITEM_STATS_SUBDIR_NAME

public static final java.lang.String AUX_ITEM_STATS_SUBDIR_NAME

Default name of the subdirectory in which to store header and stats

See Also:

Constant Field Values

AUX_ITEM_STATS_WRITE_PATH

public static final java.lang.String AUX_ITEM_STATS_WRITE_PATH

Full path at which to store header, item means and counts for later use

See Also:

Constant Field Values

DENORMALIZED_HEADER_FILE_NAME

public static final java.lang.String DENORMALIZED_HEADER_FILE_NAME

Name of the file to output the denormalized header to * public static final

See Also:

Constant Field Values

ITEM_COUNTS_FILE_NAME

public static final java.lang.String ITEM_COUNTS_FILE_NAME

The name of the file to output the serialized array of item counts to

See Also:

Constant Field Values

ITEM_MEANS_FILE_NAME

public static final java.lang.String ITEM_MEANS_FILE_NAME

The name of the file to output the serialized array of item means to

See Also:

Constant Field Values

Constructor Detail

DenormalizeHadoopReducer

public DenormalizeHadoopReducer()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Reducer.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

reduce

public void reduce(org.apache.hadoop.io.LongWritable key,
          java.lang.Iterable<org.apache.hadoop.io.Text> values,
          org.apache.hadoop.mapreduce.Reducer.Context context)
            throws java.io.IOException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

cleanup

public void cleanup(org.apache.hadoop.mapreduce.Reducer.Context context)
             throws java.io.IOException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException