weka.knowledgeflow.steps

Class AbstractSparkJob

java.lang.Object

weka.knowledgeflow.steps.BaseStep

weka.knowledgeflow.steps.AbstractSparkJob

All Implemented Interfaces:

java.io.Serializable, BaseStepExtender, Step

Direct Known Subclasses:

ArffHeaderSparkJob, CorrelationMatrixSparkJob, KMeansClustererSparkJob, RandomizedDataSparkJob, WekaClassifierEvaluationSparkJob, WekaClassifierSparkJob, WekaScoringSparkJob, WekaScoringSparkStep

public abstract class AbstractSparkJob
extends BaseStep

Base class for Knowledge Flow spark steps

Version:

$Revision: $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
AbstractSparkJob()

Method Summary

Modifier and Type	Method and Description
java.lang.String	getCustomEditorForStep()
java.util.List<java.lang.String>	getIncomingConnectionTypes()
java.lang.String	getJobOptions() Get the options for the underlying job
java.util.List<java.lang.String>	getOutgoingConnectionTypes()
SparkJob	getUnderlyingJob() Returns the underlying SparkJob object
void	processIncoming(Data data)
void	setJobOptions(java.lang.String opts) Set the options for the underlying job
void	setLast(boolean last)
void	start()
void	stepInit()
void	stop()

Methods inherited from class weka.knowledgeflow.steps.BaseStep

environmentSubstitute, getDefaultSettings, getInteractiveViewers, getInteractiveViewersImpls, getName, getStepManager, globalInfo, isResourceIntensive, isStopRequested, outputStructureForConnectionType, setName, setStepIsResourceIntensive, setStepManager, setStepMustRunSingleThreaded, stepMustRunSingleThreaded

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractSparkJob

public AbstractSparkJob()

Method Detail

setLast

public void setLast(boolean last)

getUnderlyingJob

public SparkJob getUnderlyingJob()

Returns the underlying SparkJob object

Returns:

the underlying SparkJob object

getJobOptions

public java.lang.String getJobOptions()

Get the options for the underlying job

Returns:

options for the underlying job

setJobOptions

public void setJobOptions(java.lang.String opts)

Set the options for the underlying job

Parameters:

opts - options for the underlying job

stepInit

public void stepInit()
              throws WekaException

Throws:

WekaException

start

public void start()
           throws WekaException

Specified by:

start in interface BaseStepExtender

Specified by:

start in interface Step

Overrides:

start in class BaseStep

Throws:

WekaException

processIncoming

public void processIncoming(Data data)
                     throws WekaException

Specified by:

processIncoming in interface BaseStepExtender

Specified by:

processIncoming in interface Step

Overrides:

processIncoming in class BaseStep

Throws:

WekaException

stop

public void stop()

Specified by:

stop in interface Step

Overrides:

stop in class BaseStep

getIncomingConnectionTypes

public java.util.List<java.lang.String> getIncomingConnectionTypes()

getOutgoingConnectionTypes

public java.util.List<java.lang.String> getOutgoingConnectionTypes()

getCustomEditorForStep

public java.lang.String getCustomEditorForStep()

Specified by:

getCustomEditorForStep in interface Step

Overrides:

getCustomEditorForStep in class BaseStep