TokenTypeSinkFilter and TeeSinkTokenFilter instead.public class TokenTypeSinkTokenizer extends SinkTokenizer
Token.type() matches the passed in typeToMatch then
add it to the sinkAttributeSource.AttributeFactory, AttributeSource.Stateiter, lst| Constructor and Description |
|---|
TokenTypeSinkTokenizer(int initCap,
java.lang.String typeToMatch)
Deprecated.
|
TokenTypeSinkTokenizer(java.util.List input,
java.lang.String typeToMatch)
Deprecated.
|
TokenTypeSinkTokenizer(java.lang.String typeToMatch)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
void |
add(Token t)
Deprecated.
Override this method to cache only certain tokens, or new tokens based
on the old tokens.
|
close, getTokens, next, resetcorrectOffset, resetend, getOnlyUseNewAPI, incrementToken, next, setOnlyUseNewAPIaddAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toStringpublic TokenTypeSinkTokenizer(java.lang.String typeToMatch)
public TokenTypeSinkTokenizer(int initCap,
java.lang.String typeToMatch)
public TokenTypeSinkTokenizer(java.util.List input,
java.lang.String typeToMatch)
public void add(Token t)
SinkTokenizeradd in class SinkTokenizert - The Token to add to the sinkCopyright © 2000-2016 Apache Software Foundation. All Rights Reserved.