org.apache.lucene.misc

Class HighFreqTerms

java.lang.Object

org.apache.lucene.misc.HighFreqTerms

public class HighFreqTerms
extends java.lang.Object

HighFreqTerms class extracts the top n most frequent terms (by document frequency ) from an existing Lucene index and reports their document frequency. If used with the -t flag it also reports their total tf (total number of occurences) in order of highest total tf

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULTnumTerms
static int	numTerms

Constructor Summary

Constructors

Constructor and Description
HighFreqTerms()

Method Summary

Modifier and Type	Method and Description
static org.apache.lucene.misc.TermStats[]	getHighFreqTerms(IndexReader reader, int numTerms, java.lang.String field)
static long	getTotalTermFreq(IndexReader reader, Term term)
static void	main(java.lang.String[] args)
static org.apache.lucene.misc.TermStats[]	sortByTotalTermFreq(IndexReader reader, org.apache.lucene.misc.TermStats[] terms) Takes array of TermStats.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULTnumTerms

public static final int DEFAULTnumTerms

See Also:

Constant Field Values

numTerms

public static int numTerms

Constructor Detail

HighFreqTerms

public HighFreqTerms()

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception

getHighFreqTerms

public static org.apache.lucene.misc.TermStats[] getHighFreqTerms(IndexReader reader,
                                                                  int numTerms,
                                                                  java.lang.String field)
                                                           throws java.lang.Exception

Parameters:

reader -

numTerms -

field -

Returns:

TermStats[] ordered by terms with highest docFreq first.

Throws:

java.lang.Exception

sortByTotalTermFreq

public static org.apache.lucene.misc.TermStats[] sortByTotalTermFreq(IndexReader reader,
                                                                     org.apache.lucene.misc.TermStats[] terms)
                                                              throws java.lang.Exception

Takes array of TermStats. For each term looks up the tf for each doc containing the term and stores the total in the output array of TermStats. Output array is sorted by highest total tf.

Parameters:

reader -

terms - TermStats[]

Returns:

TermStats[]

Throws:

java.lang.Exception

getTotalTermFreq

public static long getTotalTermFreq(IndexReader reader,
                                    Term term)
                             throws java.lang.Exception

Throws:

java.lang.Exception