public final class PersianAnalyzer
extends org.apache.lucene.analysis.Analyzer
Analyzer for Persian.
This Analyzer uses ArabicLetterTokenizer which implies tokenizing around
zero-width non-joiner in addition to whitespace. Some persian-specific variant forms (such as farsi
yeh and keheh) are standardized. "Stemming" is accomplished via stopwords.
| Modifier and Type | Field and Description |
|---|---|
static java.lang.String |
DEFAULT_STOPWORD_FILE
File containing default Persian stopwords.
|
static java.lang.String |
STOPWORDS_COMMENT
The comment character in the stopwords file.
|
| Constructor and Description |
|---|
PersianAnalyzer()
Deprecated.
Use
PersianAnalyzer(Version) instead |
PersianAnalyzer(java.io.File stopwords)
Deprecated.
Use
PersianAnalyzer(Version, File) instead |
PersianAnalyzer(java.util.Hashtable stopwords)
Deprecated.
Use
PersianAnalyzer(Version, Hashtable) instead |
PersianAnalyzer(java.lang.String[] stopwords)
Deprecated.
Use
PersianAnalyzer(Version, String[]) instead |
PersianAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE. |
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.io.File stopwords)
Builds an analyzer with the given stop words.
|
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.util.Hashtable stopwords)
Builds an analyzer with the given stop words.
|
PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.lang.String[] stopwords)
Builds an analyzer with the given stop words.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.lucene.analysis.TokenStream |
reusableTokenStream(java.lang.String fieldName,
java.io.Reader reader)
Returns a (possibly reused)
TokenStream which tokenizes all the text
in the provided Reader. |
org.apache.lucene.analysis.TokenStream |
tokenStream(java.lang.String fieldName,
java.io.Reader reader)
Creates a
TokenStream which tokenizes all the text in the provided
Reader. |
public static final java.lang.String DEFAULT_STOPWORD_FILE
public static final java.lang.String STOPWORDS_COMMENT
public PersianAnalyzer()
PersianAnalyzer(Version) insteadDEFAULT_STOPWORD_FILE.public PersianAnalyzer(org.apache.lucene.util.Version matchVersion)
DEFAULT_STOPWORD_FILE.public PersianAnalyzer(java.lang.String[] stopwords)
PersianAnalyzer(Version, String[]) insteadpublic PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.lang.String[] stopwords)
public PersianAnalyzer(java.util.Hashtable stopwords)
PersianAnalyzer(Version, Hashtable) insteadpublic PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.util.Hashtable stopwords)
public PersianAnalyzer(java.io.File stopwords)
throws java.io.IOException
PersianAnalyzer(Version, File) insteadSTOPWORDS_COMMENTjava.io.IOExceptionpublic PersianAnalyzer(org.apache.lucene.util.Version matchVersion,
java.io.File stopwords)
throws java.io.IOException
STOPWORDS_COMMENTjava.io.IOExceptionpublic org.apache.lucene.analysis.TokenStream tokenStream(java.lang.String fieldName,
java.io.Reader reader)
TokenStream which tokenizes all the text in the provided
Reader.tokenStream in class org.apache.lucene.analysis.AnalyzerTokenStream built from a ArabicLetterTokenizer
filtered with LowerCaseFilter,
ArabicNormalizationFilter,
PersianNormalizationFilter and Persian Stop wordspublic org.apache.lucene.analysis.TokenStream reusableTokenStream(java.lang.String fieldName,
java.io.Reader reader)
throws java.io.IOException
TokenStream which tokenizes all the text
in the provided Reader.reusableTokenStream in class org.apache.lucene.analysis.AnalyzerTokenStream built from a ArabicLetterTokenizer
filtered with LowerCaseFilter,
ArabicNormalizationFilter,
PersianNormalizationFilter and Persian Stop wordsjava.io.IOExceptionCopyright © 2000-2016 Apache Software Foundation. All Rights Reserved.