org.apache.lucene.index

Class BaseCompoundFormatTestCase

java.lang.Object

org.junit.Assert

org.apache.lucene.util.LuceneTestCase

org.apache.lucene.index.BaseCompoundFormatTestCase

public abstract class BaseCompoundFormatTestCase
extends LuceneTestCase

Abstract class to do basic tests for a compound format. NOTE: This test focuses on the compound impl, nothing else. The [stretch] goal is for this test to be so thorough in testing a new CompoundFormat that if this test passes, then all Lucene/Solr tests should also pass. Ie, if there is some bug in a given CompoundFormat that this test fails to catch then this test needs to be improved!

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.LuceneTestCase

LuceneTestCase.AwaitsFix, LuceneTestCase.BadApple, LuceneTestCase.Monster, LuceneTestCase.Nightly, LuceneTestCase.Slow, LuceneTestCase.SuppressCodecs, LuceneTestCase.SuppressFileSystems, LuceneTestCase.SuppressFsync, LuceneTestCase.SuppressReproduceLine, LuceneTestCase.SuppressSysoutChecks, LuceneTestCase.SuppressTempFileChecks, LuceneTestCase.ThrowingRunnable, LuceneTestCase.Weekly

Field Summary

Fields inherited from class org.apache.lucene.util.LuceneTestCase

assertsAreEnabled, classRules, DEFAULT_LINE_DOCS_FILE, INFOSTREAM, JENKINS_LARGE_LINE_DOCS_FILE, LEAVE_TEMPORARY, MAYBE_CACHE_POLICY, RANDOM_MULTIPLIER, ruleChain, suiteFailureMarker, SYSPROP_AWAITSFIX, SYSPROP_BADAPPLES, SYSPROP_FAILFAST, SYSPROP_MAXFAILURES, SYSPROP_MONSTER, SYSPROP_NIGHTLY, SYSPROP_SLOW, SYSPROP_WEEKLY, TEST_ASSERTS_ENABLED, TEST_AWAITSFIX, TEST_BADAPPLES, TEST_CODEC, TEST_DIRECTORY, TEST_DOCVALUESFORMAT, TEST_LINE_DOCS_FILE, TEST_MONSTER, TEST_NIGHTLY, TEST_POSTINGSFORMAT, TEST_SLOW, TEST_THROTTLING, TEST_WEEKLY, VERBOSE

Constructor Summary

Constructors

Constructor and Description
BaseCompoundFormatTestCase()

Method Summary

Modifier and Type	Method and Description
protected void	addRandomFields(Document doc) Add random fields to the provided document.
protected <D extends Directory> D	applyCreatedVersionMajor(D d) Set the created version of the given Directory and return it.
protected static void	assertEqualArrays(java.lang.String msg, byte[] expected, byte[] test, int start, int len)
protected static void	assertSameSeekBehavior(java.lang.String msg, IndexInput expected, IndexInput actual)
protected static void	assertSameStreams(java.lang.String msg, IndexInput expected, IndexInput test)
protected static void	assertSameStreams(java.lang.String msg, IndexInput expected, IndexInput actual, long seekTo)
protected static Directory	createLargeCFS(Directory dir) Setup a large compound file with a number of components, each of which is a sequential file (so that we can easily tell that we are reading in the right byte).
protected static void	createRandomFile(Directory dir, java.lang.String name, int size, byte[] segId) Creates a file of the specified size with random data.
protected static void	createSequenceFile(Directory dir, java.lang.String name, byte start, int size, byte[] segID, java.lang.String segSuffix) Creates a file of the specified size with sequential data.
protected java.util.Collection<java.lang.String>	excludedExtensionsFromByteCounts() Return the list of extensions that should be excluded from byte counts when comparing indices that store the same content.
protected abstract Codec	getCodec() Returns the codec to run tests against
protected int	getCreatedVersionMajor() Returns the major version that this codec is compatible with.
protected boolean	mergeIsStable()
protected static SegmentInfo	newSegmentInfo(Directory dir, java.lang.String name) Returns a new fake segment
void	setUp() For subclasses to override.
void	tearDown() For subclasses to override.
void	testClonedStreamsClosing()
void	testCorruptFilesAreCaught()
void	testCreateOutputDisabled()
void	testDeleteFileDisabled()
void	testDoubleClose()
void	testEmpty()
void	testFileNotFound()
void	testLargeCFS()
void	testListAll()
void	testMakeLockDisabled()
void	testManySubFiles()
void	testMergeStability() The purpose of this test is to make sure that bulk merge doesn't accumulate useless data over runs.
void	testMissingCodecHeadersAreCaught()
void	testMultiClose() Calls close multiple times on closeable codec apis
void	testPassIOContext()
void	testRamBytesUsed() Test the accuracy of the ramBytesUsed estimations.
void	testRandomAccess() This test opens two files from a compound stream and verifies that their file positions are independent of each other.
void	testRandomAccessClones() This test opens two files from a compound stream and verifies that their file positions are independent of each other.
void	testRandomExceptions() Tests exception handling on write and openInput/createOutput
void	testRandomFiles() This test creates a compound file based on a large number of files of various length.
void	testReadPastEOF()
void	testRenameFileDisabled()
void	testResourceNameInsideCompoundFile()
void	testSingleFile() This test creates compound file based on a single file.
void	testSyncDisabled()
void	testTwoFiles() This test creates compound file based on two files.

Methods inherited from class org.apache.lucene.util.LuceneTestCase

addVirusChecker, assertDeletedDocsEquals, assertDocsAndPositionsEnumEquals, assertDocsEnumEquals, assertDocsSkippingEquals, assertDocValuesEquals, assertDocValuesEquals, assertFieldInfosEquals, assertFieldsEquals, assertFieldStatisticsEquals, assertNormsEquals, assertPointsEquals, assertPositionsSkippingEquals, assertReaderEquals, assertReaderStatisticsEquals, assertStoredFieldEquals, assertStoredFieldsEquals, assertTermsEnumEquals, assertTermsEquals, assertTermsStatisticsEquals, assertTermStatsEquals, assertTermVectorsEquals, asSet, assumeFalse, assumeNoException, assumeTrue, assumeWorkingMMapOnWindows, atLeast, atLeast, closeAfterSuite, closeAfterTest, collate, createTempDir, createTempDir, createTempFile, createTempFile, dumpArray, dumpIterator, expectThrows, expectThrows, expectThrows, expectThrowsAnyOf, expectThrowsAnyOf, getBaseTempDirForTestClass, getDataInputStream, getDataPath, getOnlyLeafReader, getTestClass, getTestName, hasWorkingMMapOnWindows, isTestThread, localeForLanguageTag, maybeChangeLiveIndexWriterConfig, maybeWrapReader, newAlcoholicMergePolicy, newAlcoholicMergePolicy, newDirectory, newDirectory, newDirectory, newDirectory, newDirectory, newField, newField, newFSDirectory, newFSDirectory, newIndexWriterConfig, newIndexWriterConfig, newIndexWriterConfig, newIOContext, newIOContext, newLogMergePolicy, newLogMergePolicy, newLogMergePolicy, newLogMergePolicy, newLogMergePolicy, newMaybeVirusCheckingDirectory, newMaybeVirusCheckingFSDirectory, newMergePolicy, newMergePolicy, newMergePolicy, newMockDirectory, newMockDirectory, newMockDirectory, newMockFSDirectory, newMockFSDirectory, newSearcher, newSearcher, newSearcher, newStringField, newStringField, newStringField, newStringField, newTextField, newTextField, newTieredMergePolicy, newTieredMergePolicy, overrideDefaultQueryCache, overrideTestDefaultQueryCache, random, randomLocale, randomTimeZone, rarely, rarely, replaceMaxFailureRule, resetDefaultQueryCache, restoreCPUCoreCount, restoreIndexWriterMaxDocs, restoreSpins, runWithRestrictedPermissions, setIndexWriterMaxDocs, setupCPUCoreCount, setupSpins, slowFileExists, usually, usually, wrapReader

Methods inherited from class org.junit.Assert

assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotEquals, assertNotEquals, assertNotEquals, assertNotEquals, assertNotEquals, assertNotEquals, assertNotEquals, assertNotEquals, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertThat, assertThat, assertThrows, assertThrows, assertTrue, assertTrue, fail, fail

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseCompoundFormatTestCase

public BaseCompoundFormatTestCase()

Method Detail

testEmpty

public void testEmpty()
               throws java.io.IOException

Throws:

java.io.IOException

testSingleFile

public void testSingleFile()
                    throws java.io.IOException

This test creates compound file based on a single file. Files of different sizes are tested: 0, 1, 10, 100 bytes.

Throws:

java.io.IOException

testTwoFiles

public void testTwoFiles()
                  throws java.io.IOException

This test creates compound file based on two files.

Throws:

java.io.IOException

testDoubleClose

public void testDoubleClose()
                     throws java.io.IOException

Throws:

java.io.IOException

testPassIOContext

public void testPassIOContext()
                       throws java.io.IOException

Throws:

java.io.IOException

testLargeCFS

public void testLargeCFS()
                  throws java.io.IOException

Throws:

java.io.IOException

testListAll

public void testListAll()
                 throws java.lang.Exception

Throws:

java.lang.Exception

testCreateOutputDisabled

public void testCreateOutputDisabled()
                              throws java.io.IOException

Throws:

java.io.IOException

testDeleteFileDisabled

public void testDeleteFileDisabled()
                            throws java.io.IOException

Throws:

java.io.IOException

testRenameFileDisabled

public void testRenameFileDisabled()
                            throws java.io.IOException

Throws:

java.io.IOException

testSyncDisabled

public void testSyncDisabled()
                      throws java.io.IOException

Throws:

java.io.IOException

testMakeLockDisabled

public void testMakeLockDisabled()
                          throws java.io.IOException

Throws:

java.io.IOException

testRandomFiles

public void testRandomFiles()
                     throws java.io.IOException

This test creates a compound file based on a large number of files of various length. The file content is generated randomly. The sizes range from 0 to 1Mb. Some of the sizes are selected to test the buffering logic in the file reading code. For this the chunk variable is set to the length of the buffer used internally by the compound file logic.

Throws:

java.io.IOException

testManySubFiles

public void testManySubFiles()
                      throws java.io.IOException

Throws:

java.io.IOException

testClonedStreamsClosing

public void testClonedStreamsClosing()
                              throws java.io.IOException

Throws:

java.io.IOException

testRandomAccess

public void testRandomAccess()
                      throws java.io.IOException

This test opens two files from a compound stream and verifies that their file positions are independent of each other.

Throws:

java.io.IOException

testRandomAccessClones

public void testRandomAccessClones()
                            throws java.io.IOException

This test opens two files from a compound stream and verifies that their file positions are independent of each other.

Throws:

java.io.IOException

testFileNotFound

public void testFileNotFound()
                      throws java.io.IOException

Throws:

java.io.IOException

testReadPastEOF

public void testReadPastEOF()
                     throws java.io.IOException

Throws:

java.io.IOException

newSegmentInfo

protected static SegmentInfo newSegmentInfo(Directory dir,
                                            java.lang.String name)

Returns a new fake segment

createRandomFile

protected static void createRandomFile(Directory dir,
                                       java.lang.String name,
                                       int size,
                                       byte[] segId)
                                throws java.io.IOException

Creates a file of the specified size with random data.

Throws:

java.io.IOException

createSequenceFile

protected static void createSequenceFile(Directory dir,
                                         java.lang.String name,
                                         byte start,
                                         int size,
                                         byte[] segID,
                                         java.lang.String segSuffix)
                                  throws java.io.IOException

Creates a file of the specified size with sequential data. The first byte is written as the start byte provided. All subsequent bytes are computed as start + offset where offset is the number of the byte.

Throws:

java.io.IOException

assertSameStreams

protected static void assertSameStreams(java.lang.String msg,
                                        IndexInput expected,
                                        IndexInput test)
                                 throws java.io.IOException

Throws:

java.io.IOException

assertSameStreams

protected static void assertSameStreams(java.lang.String msg,
                                        IndexInput expected,
                                        IndexInput actual,
                                        long seekTo)
                                 throws java.io.IOException

Throws:

java.io.IOException

assertSameSeekBehavior

protected static void assertSameSeekBehavior(java.lang.String msg,
                                             IndexInput expected,
                                             IndexInput actual)
                                      throws java.io.IOException

Throws:

java.io.IOException

assertEqualArrays

protected static void assertEqualArrays(java.lang.String msg,
                                        byte[] expected,
                                        byte[] test,
                                        int start,
                                        int len)

createLargeCFS

protected static Directory createLargeCFS(Directory dir)
                                   throws java.io.IOException

Setup a large compound file with a number of components, each of which is a sequential file (so that we can easily tell that we are reading in the right byte). The methods sets up 20 files - _123.0 to _123.19, the size of each file is 1000 bytes.

Throws:

java.io.IOException

addRandomFields

protected void addRandomFields(Document doc)

Add random fields to the provided document.

testMergeStability

public void testMergeStability()
                        throws java.lang.Exception

The purpose of this test is to make sure that bulk merge doesn't accumulate useless data over runs.

Throws:

java.lang.Exception

testResourceNameInsideCompoundFile

public void testResourceNameInsideCompoundFile()
                                        throws java.lang.Exception

Throws:

java.lang.Exception

testMissingCodecHeadersAreCaught

public void testMissingCodecHeadersAreCaught()
                                      throws java.lang.Exception

Throws:

java.lang.Exception

testCorruptFilesAreCaught

public void testCorruptFilesAreCaught()
                               throws java.lang.Exception

Throws:

java.lang.Exception

getCodec

protected abstract Codec getCodec()

Returns the codec to run tests against

getCreatedVersionMajor

protected int getCreatedVersionMajor()

Returns the major version that this codec is compatible with.

applyCreatedVersionMajor

protected final <D extends Directory> D applyCreatedVersionMajor(D d)
                                                          throws java.io.IOException

Set the created version of the given Directory and return it.

Throws:

java.io.IOException

setUp

public void setUp()
           throws java.lang.Exception

Description copied from class: LuceneTestCase

For subclasses to override. Overrides must call super.setUp().

Overrides:

setUp in class LuceneTestCase

Throws:

java.lang.Exception

tearDown

public void tearDown()
              throws java.lang.Exception

Description copied from class: LuceneTestCase

For subclasses to override. Overrides must call super.tearDown().

Overrides:

tearDown in class LuceneTestCase

Throws:

java.lang.Exception

excludedExtensionsFromByteCounts

protected java.util.Collection<java.lang.String> excludedExtensionsFromByteCounts()

Return the list of extensions that should be excluded from byte counts when comparing indices that store the same content.

mergeIsStable

protected boolean mergeIsStable()

testRamBytesUsed

@LuceneTestCase.Slow
public void testRamBytesUsed()
                                           throws java.io.IOException

Test the accuracy of the ramBytesUsed estimations.

Throws:

java.io.IOException

testMultiClose

public void testMultiClose()
                    throws java.io.IOException

Calls close multiple times on closeable codec apis

Throws:

java.io.IOException

testRandomExceptions

public void testRandomExceptions()
                          throws java.lang.Exception

Tests exception handling on write and openInput/createOutput

Throws:

java.lang.Exception