weka.distributed.hadoop

Class CSVToArffHeaderHadoopReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

weka.distributed.hadoop.CSVToArffHeaderHadoopReducer

public class CSVToArffHeaderHadoopReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Reducer implementation for the ArffHeaderHadoopJob

Version:

$Revision: 11837 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CHART_HEIGHT_KEY key for specifying a chart height to use
static java.lang.String	CHART_WIDTH_KEY key for specifying a chart width to use
static java.lang.String	CSV_TO_ARFF_HEADER_WRITE_PATH Key for the property that holds the write path for the output header file
static int	DEFAULT_CHART_HEIGHT Default height for charts
static int	DEFAULT_CHART_WIDTH Default width for charts

Constructor Summary

Constructors

Constructor and Description
CSVToArffHeaderHadoopReducer()

Method Summary

Modifier and Type	Method and Description
void	reduce(org.apache.hadoop.io.Text key, java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values, org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)
static void	writeSummaryStatsStringToDestination(Instances headerWithSummary, java.lang.String outputFile, boolean quantiles, int decimalPlaces, org.apache.hadoop.conf.Configuration conf)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CHART_WIDTH_KEY

public static final java.lang.String CHART_WIDTH_KEY

key for specifying a chart width to use

See Also:

Constant Field Values

CHART_HEIGHT_KEY

public static final java.lang.String CHART_HEIGHT_KEY

key for specifying a chart height to use

See Also:

Constant Field Values

DEFAULT_CHART_WIDTH

public static final int DEFAULT_CHART_WIDTH

Default width for charts

See Also:

Constant Field Values

DEFAULT_CHART_HEIGHT

public static final int DEFAULT_CHART_HEIGHT

Default height for charts

See Also:

Constant Field Values

CSV_TO_ARFF_HEADER_WRITE_PATH

public static java.lang.String CSV_TO_ARFF_HEADER_WRITE_PATH

Key for the property that holds the write path for the output header file

Constructor Detail

CSVToArffHeaderHadoopReducer

public CSVToArffHeaderHadoopReducer()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Reducer.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

reduce

public void reduce(org.apache.hadoop.io.Text key,
                   java.lang.Iterable<org.apache.hadoop.io.BytesWritable> values,
                   org.apache.hadoop.mapreduce.Reducer.Context context)
            throws java.io.IOException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

writeSummaryStatsStringToDestination

public static void writeSummaryStatsStringToDestination(Instances headerWithSummary,
                                                        java.lang.String outputFile,
                                                        boolean quantiles,
                                                        int decimalPlaces,
                                                        org.apache.hadoop.conf.Configuration conf)
                                                 throws java.io.IOException,
                                                        weka.distributed.DistributedWekaException

Throws:

java.io.IOException

weka.distributed.DistributedWekaException