weka.distributed.hadoop

Class CSVToArffHeaderHadoopMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

weka.distributed.hadoop.CSVToArffHeaderHadoopMapper

public class CSVToArffHeaderHadoopMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Mapper implementation for the ArffHeaderHadoop job

Version:

$Revision: 11020 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CSV_TO_ARFF_HEADER_MAP_TASK_OPTIONS The key in the Configuration that the options for this task are associated with

Constructor Summary

Constructors

Constructor and Description
CSVToArffHeaderHadoopMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
void	map(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context)
static java.util.List<java.lang.String>	readNames(java.io.BufferedReader br) Read attribute names (one per line) from the supplied Reader
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CSV_TO_ARFF_HEADER_MAP_TASK_OPTIONS

public static java.lang.String CSV_TO_ARFF_HEADER_MAP_TASK_OPTIONS

The key in the Configuration that the options for this task are associated with

Constructor Detail

CSVToArffHeaderHadoopMapper

public CSVToArffHeaderHadoopMapper()

Method Detail

readNames

public static java.util.List<java.lang.String> readNames(java.io.BufferedReader br)
                                                  throws java.io.IOException

Read attribute names (one per line) from the supplied Reader

Parameters:

br - the BufferedReader to read from

Returns:

a list of attribute names

Throws:

java.io.IOException - if a problem occurs

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           throws java.io.IOException

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

map

public void map(org.apache.hadoop.io.LongWritable key,
       org.apache.hadoop.io.Text value,
       org.apache.hadoop.mapreduce.Mapper.Context context)
         throws java.io.IOException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

cleanup

public void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
             throws java.io.IOException,
                    java.lang.InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.BytesWritable>

Throws:

java.io.IOException

java.lang.InterruptedException