public class AlphabeticTokenizer extends Tokenizer
Constructor and Description |
---|
AlphabeticTokenizer() |
Modifier and Type | Method and Description |
---|---|
java.lang.String |
getRevision()
Returns the revision string.
|
java.lang.String |
globalInfo()
Returns a string describing the stemmer
|
boolean |
hasMoreElements()
returns whether there are more elements still
|
static void |
main(java.lang.String[] args)
Runs the tokenizer with the given options and strings to tokenize.
|
java.lang.Object |
nextElement()
returns the next element
|
void |
tokenize(java.lang.String s)
Sets the string to tokenize.
|
getOptions, listOptions, runTokenizer, setOptions, tokenize
public java.lang.String globalInfo()
globalInfo
in class Tokenizer
public boolean hasMoreElements()
hasMoreElements
in interface java.util.Enumeration
hasMoreElements
in class Tokenizer
public java.lang.Object nextElement()
nextElement
in interface java.util.Enumeration
nextElement
in class Tokenizer
public void tokenize(java.lang.String s)
public java.lang.String getRevision()
public static void main(java.lang.String[] args)
args
- the commandline options and strings to tokenize