weka.distributed.hadoop

Class KMeansCentroidSketchHadoopReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

weka.distributed.hadoop.KMeansCentroidSketchHadoopReducer

public class KMeansCentroidSketchHadoopReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Hadoop reducer for the k-means|| initialization procedure. Aggregates centroid candidates from the map phase.

Version:

$Revision: 11837 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	SKETCH_WRITE_PATH The key in the configuration that the write path for centroid sketches is associated with

Constructor Summary

Constructors

Constructor and Description
KMeansCentroidSketchHadoopReducer()

Method Summary

Modifier and Type	Method and Description
void	reduce(org.apache.hadoop.io.Text key, java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values, org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SKETCH_WRITE_PATH

public static final java.lang.String SKETCH_WRITE_PATH

The key in the configuration that the write path for centroid sketches is associated with

See Also:

Constant Field Values

Constructor Detail

KMeansCentroidSketchHadoopReducer

public KMeansCentroidSketchHadoopReducer()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Reducer.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

reduce

public void reduce(org.apache.hadoop.io.Text key,
                   java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values,
                   org.apache.hadoop.mapreduce.Reducer.Context context)
            throws java.io.IOException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException