Constructor and Description |
---|
PunctFilter(Sequence<Token> arg0)
Constructor for the PunctFilter object
|
Modifier and Type | Method and Description |
---|---|
boolean |
isPunctuation(Token t)
Test whether a token is a punctuation (mark) or it can be ignored.
|
Token |
next()
Return the next token.
|
action, getPrevTokenizer, setPrevTokenizer
public boolean isPunctuation(Token t)
t
- the Token to checkCopyright © 2016 Egothor. All Rights Reserved.