org.apache.lucene.analysis.ko

Class KoreanTokenizerFactory

java.lang.Object

org.apache.lucene.analysis.util.AbstractAnalysisFactory

org.apache.lucene.analysis.util.TokenizerFactory

org.apache.lucene.analysis.ko.KoreanTokenizerFactory

All Implemented Interfaces:

ResourceLoaderAware

public class KoreanTokenizerFactory
extends TokenizerFactory
implements ResourceLoaderAware

Factory for KoreanTokenizer.

 <fieldType name="text_ko" class="solr.TextField">
   <analyzer>
     <tokenizer class="solr.KoreanTokenizerFactory"
                decompoundMode="discard"
                userDictionary="user.txt"
                userDictionaryEncoding="UTF-8"
                outputUnknownUnigrams="false"
     />
  </analyzer>
 </fieldType>
 

Supports the following attributes:

• userDictionary: User dictionary path.
• userDictionaryEncoding: User dictionary encoding.
• decompoundMode: Decompound mode. Either 'none', 'discard', 'mixed'. Default is discard. See KoreanTokenizer.DecompoundMode
• outputUnknownUnigrams: If true outputs unigrams for unknown words.

Since:

7.4.0

Field Summary

Fields inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

Constructor Summary

Constructors

Constructor and Description
KoreanTokenizerFactory(java.util.Map<java.lang.String,java.lang.String> args) Creates a new KoreanTokenizerFactory

Method Summary

Modifier and Type	Method and Description
KoreanTokenizer	create(AttributeFactory factory) Creates a TokenStream of the specified input using the given AttributeFactory
void	inform(ResourceLoader loader) Initializes this component with the provided ResourceLoader (used for loading classes, files, etc).

Methods inherited from class org.apache.lucene.analysis.util.TokenizerFactory

availableTokenizers, create, forName, lookupClass, reloadTokenizers

Methods inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KoreanTokenizerFactory

public KoreanTokenizerFactory(java.util.Map<java.lang.String,java.lang.String> args)

Creates a new KoreanTokenizerFactory

Method Detail

inform

public void inform(ResourceLoader loader)
            throws java.io.IOException

Description copied from interface: ResourceLoaderAware

Initializes this component with the provided ResourceLoader (used for loading classes, files, etc).

Specified by:

inform in interface ResourceLoaderAware

Throws:

java.io.IOException

create

public KoreanTokenizer create(AttributeFactory factory)

Description copied from class: TokenizerFactory

Creates a TokenStream of the specified input using the given AttributeFactory

Specified by:

create in class TokenizerFactory