WordTokenFilter (Lucene 2.9.4 API)

Skip navigation links

All Classes

Summary:
Nested |
Field |
Constr |
Method

Detail:
Field |
Constr |
Method

java.lang.Object
- org.apache.lucene.util.AttributeSource
- - org.apache.lucene.analysis.TokenStream
  - - org.apache.lucene.analysis.TokenFilter
    - - org.apache.lucene.analysis.cn.smart.WordTokenFilter

```
public final class WordTokenFilter
extends org.apache.lucene.analysis.TokenFilter
```
A TokenFilter that breaks sentences into words.
WARNING: The status of the analyzers/smartcn analysis.cn.smart package is experimental. The APIs and file formats introduced here might change in the future and will not be supported anymore in such a case.

- Nested Class Summary
  - Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
    org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State
- Field Summary
  - Fields inherited from class org.apache.lucene.analysis.TokenFilter
    input
- Constructor Summary
  
  Constructors
  Constructor and Description
  
  WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
  Construct a new WordTokenizer.
- Method Summary
  
  All Methods Instance Methods Concrete Methods
  Modifier and Type Method and Description
  
  boolean incrementToken()
  
  void reset()
  - Methods inherited from class org.apache.lucene.analysis.TokenFilter
    close, end
  - Methods inherited from class org.apache.lucene.analysis.TokenStream
    getOnlyUseNewAPI, next, next, setOnlyUseNewAPI
  - Methods inherited from class org.apache.lucene.util.AttributeSource
    addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
  - Methods inherited from class java.lang.Object
    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

- Constructor Detail
  - WordTokenFilter
```
public WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
```
    Construct a new WordTokenizer.
    
    Parameters:
    
    in - TokenStream of sentences
- Method Detail
  - incrementToken
```
public boolean incrementToken()
                       throws java.io.IOException
```
    Overrides:
    
    incrementToken in class org.apache.lucene.analysis.TokenStream
    
    Throws:
    
    java.io.IOException
  - reset
```
public void reset()
           throws java.io.IOException
```
    Overrides:
    
    reset in class org.apache.lucene.analysis.TokenFilter
    
    Throws:
    
    java.io.IOException

Skip navigation links

All Classes

Summary:
Nested |
Field |
Constr |
Method

Detail:
Field |
Constr |
Method

Copyright © 2000-2016 Apache Software Foundation. All Rights Reserved.