weka.distributed.hadoop

Class KMeansHadoopReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

weka.distributed.hadoop.KMeansHadoopReducer

public class KMeansHadoopReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Hadoop reducer for a k-means iteration

Version:

$Revision: 11837 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	KMEANS_REDUCE_FILE_PREFIX File prefix for serialized reducers
static java.lang.String	KMEANS_WRITE_PATH The key in the configuration that the write path for k-means centroids is associated with

Constructor Summary

Constructors

Constructor and Description
KMeansHadoopReducer()

Method Summary

Modifier and Type	Method and Description
void	reduce(org.apache.hadoop.io.Text key, java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values, org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KMEANS_WRITE_PATH

public static final java.lang.String KMEANS_WRITE_PATH

The key in the configuration that the write path for k-means centroids is associated with

See Also:

Constant Field Values

KMEANS_REDUCE_FILE_PREFIX

public static final java.lang.String KMEANS_REDUCE_FILE_PREFIX

File prefix for serialized reducers

See Also:

Constant Field Values

Constructor Detail

KMeansHadoopReducer

public KMeansHadoopReducer()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Reducer.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

reduce

public void reduce(org.apache.hadoop.io.Text key,
                   java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values,
                   org.apache.hadoop.mapreduce.Reducer.Context context)
            throws java.io.IOException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException