weka.core.converters

Class HDFSSaver

java.lang.Object

weka.core.converters.AbstractSaver

weka.core.converters.HDFSSaver

All Implemented Interfaces:

java.io.Serializable, CapabilitiesHandler, CapabilitiesIgnorer, CommandlineRunnable, BatchConverter, IncrementalConverter, Saver, EnvironmentHandler, OptionHandler, RevisionHandler

public class HDFSSaver
extends AbstractSaver
implements IncrementalConverter, BatchConverter, OptionHandler, CapabilitiesHandler, EnvironmentHandler, CommandlineRunnable

Saver for writing to HDFS. Delegates to a base saver for writing the actual file format.

Version:

$Revision: 11166 $

Author:

Mark Hall (mhall{[at]}pentaho{[dot]}com)

See Also:

Serialized Form

Field Summary

Fields inherited from interface weka.core.converters.Saver

BATCH, INCREMENTAL, NONE

Constructor Summary

Constructors

Constructor and Description
HDFSSaver() Constructor

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	DFSReplicationFactorTipText() The tip text for this property
java.lang.String	filePrefix()
Capabilities	getCapabilities() Returns the Capabilities of this saver.
HDFSConfig	getConfig() Get the HDFSConfig
java.lang.String	getDFSReplicationFactor() Get the dfs replication factor to use
java.lang.String	getHDFSPath() Get the path to save to in HDFS
java.lang.String[]	getOptions()
java.lang.String	getRevision()
AbstractFileSaver	getSaver() Get the base saver to use
java.lang.String	globalInfo() Help information for the HDFSSaver
java.lang.String	HDFSPathTipText() The tip text for this property
java.util.Enumeration<Option>	listOptions()
static void	main(java.lang.String[] args) Main method.
void	resetOptions()
void	run(java.lang.Object toRun, java.lang.String[] options)
java.lang.String	saverTipText() The tip text for this property
void	setDFSReplicationFactor(java.lang.String factor) Set the dfs replication factor to use
void	setDirAndPrefix(java.lang.String relationName, java.lang.String add)
void	setEnvironment(Environment env)
void	setFilePrefix(java.lang.String prefix)
void	setHDFSPath(java.lang.String path) Set the path to save to in HDFS
void	setOptions(java.lang.String[] options)
void	setSaver(AbstractFileSaver saver) Set the base saver to use
void	writeBatch()
void	writeIncremental(Instance inst)

Methods inherited from class weka.core.converters.AbstractSaver

cancel, doNotCheckCapabilitiesTipText, getDoNotCheckCapabilities, getFileExtension, getInstances, getWriteMode, resetStructure, retrieveDir, setDestination, setDestination, setDir, setDoNotCheckCapabilities, setFile, setInstances, setRetrieval, setStructure

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HDFSSaver

public HDFSSaver()

Constructor

Method Detail

globalInfo

public java.lang.String globalInfo()

Help information for the HDFSSaver

Returns:

textual help information

resetOptions

public void resetOptions()

Overrides:

resetOptions in class AbstractSaver

getCapabilities

public Capabilities getCapabilities()

Returns the Capabilities of this saver.

Specified by:

getCapabilities in interface CapabilitiesHandler

Overrides:

getCapabilities in class AbstractSaver

Returns:

the capabilities of this object

See Also:

Capabilities

listOptions

public java.util.Enumeration<Option> listOptions()

Specified by:

listOptions in interface OptionHandler

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Specified by:

setOptions in interface OptionHandler

Throws:

java.lang.Exception

getOptions

public java.lang.String[] getOptions()

Specified by:

getOptions in interface OptionHandler

getConfig

public HDFSConfig getConfig()

Get the HDFSConfig

Returns:

the HDFSConfig

DFSReplicationFactorTipText

public java.lang.String DFSReplicationFactorTipText()

The tip text for this property

Returns:

the tool tip text for this property

setDFSReplicationFactor

public void setDFSReplicationFactor(java.lang.String factor)

Set the dfs replication factor to use

Parameters:

factor - the factor to use

getDFSReplicationFactor

public java.lang.String getDFSReplicationFactor()

Get the dfs replication factor to use

Returns:

the factor to use

HDFSPathTipText

public java.lang.String HDFSPathTipText()

The tip text for this property

Returns:

the tool tip text for this property

setHDFSPath

public void setHDFSPath(java.lang.String path)

Set the path to save to in HDFS

Parameters:

path - the path to save to

getHDFSPath

public java.lang.String getHDFSPath()

Get the path to save to in HDFS

Returns:

the path to save to

saverTipText

public java.lang.String saverTipText()

The tip text for this property

Returns:

the tool tip text for this property

setSaver

public void setSaver(AbstractFileSaver saver)

Set the base saver to use

Parameters:

saver - the base saver to use

getSaver

public AbstractFileSaver getSaver()

Get the base saver to use

Returns:

the base saver to use

getRevision

public java.lang.String getRevision()

Specified by:

getRevision in interface RevisionHandler

setFilePrefix

public void setFilePrefix(java.lang.String prefix)

Specified by:

setFilePrefix in interface Saver

Overrides:

setFilePrefix in class AbstractSaver

filePrefix

public java.lang.String filePrefix()

Specified by:

filePrefix in interface Saver

Overrides:

filePrefix in class AbstractSaver

setDirAndPrefix

public void setDirAndPrefix(java.lang.String relationName,
                   java.lang.String add)

Specified by:

setDirAndPrefix in interface Saver

Overrides:

setDirAndPrefix in class AbstractSaver

writeIncremental

public void writeIncremental(Instance inst)
                      throws java.io.IOException

Specified by:

writeIncremental in interface Saver

Overrides:

writeIncremental in class AbstractSaver

Throws:

java.io.IOException

writeBatch

public void writeBatch()
                throws java.io.IOException

Specified by:

writeBatch in interface Saver

Specified by:

writeBatch in class AbstractSaver

Throws:

java.io.IOException

setEnvironment

public void setEnvironment(Environment env)

Specified by:

setEnvironment in interface EnvironmentHandler

main

public static void main(java.lang.String[] args)

Main method.

Parameters:

args - should contain the options of a Saver.

run

public void run(java.lang.Object toRun,
       java.lang.String[] options)

Specified by:

run in interface CommandlineRunnable