Constructor and Description |
---|
ParagraphPunctFilter(Sequence<Token> prev)
Constructor for the ParagraphPunctFilter object
|
Modifier and Type | Method and Description |
---|---|
static boolean |
isParagraphDelimiter(Token t)
Test whether a token is a paragraph delimiter.
|
static boolean |
isPunctuation(Token t)
Test whether a token is a punctuation (mark).
|
Token |
next()
Return the next token.
|
action, getPrevTokenizer, setPrevTokenizer
public static boolean isParagraphDelimiter(Token t)
t
- the Token to checkpublic static boolean isPunctuation(Token t)
t
- the Token to checkCopyright © 2016 Egothor. All Rights Reserved.