org.apache.lucene.store

Class MockDirectoryWrapper

java.lang.Object

org.apache.lucene.store.Directory

org.apache.lucene.store.FilterDirectory

org.apache.lucene.store.BaseDirectoryWrapper

org.apache.lucene.store.MockDirectoryWrapper

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class MockDirectoryWrapper
extends BaseDirectoryWrapper

This is a Directory Wrapper that adds methods intended to be used only by unit tests. It also adds a number of features useful for testing:

• Instances created by LuceneTestCase.newDirectory() are tracked to ensure they are closed by the test.
• When a MockDirectoryWrapper is closed, it will throw an exception if it has any open files against it (with a stacktrace indicating where they were opened from).
• When a MockDirectoryWrapper is closed, it runs CheckIndex to test if the index was corrupted.
• MockDirectoryWrapper simulates some "features" of Windows, such as refusing to write/delete to open files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MockDirectoryWrapper.Failure Objects that represent fail-able conditions.
static class	MockDirectoryWrapper.FakeIOException Use this when throwing fake IOException, e.g.
static class	MockDirectoryWrapper.Throttling Enum for controlling hard disk throttling.

Field Summary

Fields inherited from class org.apache.lucene.store.BaseDirectoryWrapper

isOpen

Fields inherited from class org.apache.lucene.store.FilterDirectory

in

Constructor Summary

Constructors

Constructor and Description
MockDirectoryWrapper(java.util.Random random, Directory delegate)

Method Summary

Modifier and Type	Method and Description
void	clearCrash()
void	close() Closes the directory.
void	copyFrom(Directory from, java.lang.String src, java.lang.String dest, IOContext context) Copies an existing src file from directory from to a non-existent file dest in this directory.
void	corruptFiles(java.util.Collection<java.lang.String> files)
void	corruptUnknownFiles()
void	crash() Simulates a crash of OS or machine by overwriting unsynced files.
IndexOutput	createOutput(java.lang.String name, IOContext context) Creates a new, empty file in the directory and returns an IndexOutput instance for appending data to this file.
IndexOutput	createTempOutput(java.lang.String prefix, java.lang.String suffix, IOContext context) Creates a new, empty, temporary file in the directory and returns an IndexOutput instance for appending data to this file.
void	deleteFile(java.lang.String name) Removes an existing file in the directory.
protected void	ensureOpen() Ensures this directory is still open.
void	failOn(MockDirectoryWrapper.Failure fail) add a Failure object to the list of objects to be evaluated at every potential failure point
long	fileLength(java.lang.String name) Returns the byte length of a file in the directory.
boolean	getAssertNoDeleteOpenFile()
long	getFileHandleCount() returns current open file handle count
int	getInputCloneCount()
long	getMaxSizeInBytes()
long	getMaxUsedSizeInBytes() Returns the peek actual storage used (bytes) in this directory.
java.util.Set<java.lang.String>	getOpenDeletedFiles()
double	getRandomIOExceptionRate()
double	getRandomIOExceptionRateOnOpen()
long	getRecomputedActualSizeInBytes() Like getRecomputedSizeInBytes(), but, uses actual file lengths rather than buffer allocations (which are quantized up to nearest RAMOutputStream.BUFFER_SIZE (now 1024) bytes.
long	getRecomputedSizeInBytes() Provided for testing purposes.
java.lang.String[]	listAll() Returns names of all files stored in this directory.
Lock	obtainLock(java.lang.String name) Acquires and returns a Lock for a file with the given name.
ChecksumIndexInput	openChecksumInput(java.lang.String name, IOContext context) Opens a checksum-computing stream for reading an existing file.
IndexInput	openInput(java.lang.String name, IOContext context) Opens a stream for reading an existing file.
void	removeIndexInput(IndexInput in, java.lang.String name)
void	removeIndexOutput(IndexOutput out, java.lang.String name)
void	rename(java.lang.String source, java.lang.String dest) Renames source file to dest file where dest must not already exist in the directory.
void	resetMaxUsedSizeInBytes()
void	setAllowRandomFileNotFoundException(boolean value) If set to true (the default), when we throw random IOException on openInput or createOutput, we may sometimes throw FileNotFoundException or NoSuchFileException.
void	setAllowReadingFilesStillOpenForWrite(boolean value) If set to true, you can open an inputstream on a file that is still open for writes.
void	setAssertNoDeleteOpenFile(boolean value) Trip a test assert if there is an attempt to delete an open file.
void	setAssertNoUnrefencedFilesOnClose(boolean v)
void	setFailOnCreateOutput(boolean v)
void	setFailOnOpenInput(boolean v)
void	setMaxSizeInBytes(long maxSize)
void	setRandomIOExceptionRate(double rate) If 0.0, no exceptions will be thrown.
void	setRandomIOExceptionRateOnOpen(double rate) If 0.0, no exceptions will be thrown during openInput and createOutput.
void	setThrottling(MockDirectoryWrapper.Throttling throttling)
void	setTrackDiskUsage(boolean v)
void	setUseSlowOpenClosers(boolean v) Add a rare small sleep to catch race conditions in open/close
void	setVerboseClone(boolean v) If set to true, we print a fake exception with filename and stacktrace on every indexinput clone()
long	sizeInBytes()
void	sync(java.util.Collection<java.lang.String> names) Ensures that any writes to these files are moved to stable storage (made durable).
void	syncMetaData() Ensures that directory metadata, such as recent file renames, are moved to stable storage.
java.lang.String	toString()

Methods inherited from class org.apache.lucene.store.BaseDirectoryWrapper

getCheckIndexOnClose, getCrossCheckTermVectorsOnClose, isOpen, setCheckIndexOnClose, setCrossCheckTermVectorsOnClose

Methods inherited from class org.apache.lucene.store.FilterDirectory

getDelegate, getPendingDeletions, unwrap

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

MockDirectoryWrapper

public MockDirectoryWrapper(java.util.Random random,
                            Directory delegate)

Method Detail

getInputCloneCount

public int getInputCloneCount()

setVerboseClone

public void setVerboseClone(boolean v)

If set to true, we print a fake exception with filename and stacktrace on every indexinput clone()

setTrackDiskUsage

public void setTrackDiskUsage(boolean v)

setAllowRandomFileNotFoundException

public void setAllowRandomFileNotFoundException(boolean value)

If set to true (the default), when we throw random IOException on openInput or createOutput, we may sometimes throw FileNotFoundException or NoSuchFileException.

setAllowReadingFilesStillOpenForWrite

public void setAllowReadingFilesStillOpenForWrite(boolean value)

If set to true, you can open an inputstream on a file that is still open for writes.

setThrottling

public void setThrottling(MockDirectoryWrapper.Throttling throttling)

setUseSlowOpenClosers

public void setUseSlowOpenClosers(boolean v)

Add a rare small sleep to catch race conditions in open/close

You can enable this if you need it.

sync

public void sync(java.util.Collection<java.lang.String> names)
          throws java.io.IOException

Description copied from class: Directory

Ensures that any writes to these files are moved to stable storage (made durable). Lucene uses this to properly commit changes to the index, to prevent a machine/OS crash from corrupting the index.

Overrides:

sync in class FilterDirectory

Throws:

java.io.IOException

See Also:

Directory.syncMetaData()

rename

public void rename(java.lang.String source,
                   java.lang.String dest)
            throws java.io.IOException

Description copied from class: Directory

Renames source file to dest file where dest must not already exist in the directory. It is permitted for this operation to not be truly atomic, for example both source and dest can be visible temporarily in Directory.listAll(). However, the implementation of this method must ensure the content of dest appears as the entire source atomically. So once dest is visible for readers, the entire content of previous source is visible. This method is used by IndexWriter to publish commits.

Overrides:

rename in class FilterDirectory

Throws:

java.io.IOException

syncMetaData

public void syncMetaData()
                  throws java.io.IOException

Description copied from class: Directory

Ensures that directory metadata, such as recent file renames, are moved to stable storage.

Overrides:

syncMetaData in class FilterDirectory

Throws:

java.io.IOException

See Also:

Directory.sync(Collection)

sizeInBytes

public final long sizeInBytes()
                       throws java.io.IOException

Throws:

java.io.IOException

corruptUnknownFiles

public void corruptUnknownFiles()
                         throws java.io.IOException

Throws:

java.io.IOException

corruptFiles

public void corruptFiles(java.util.Collection<java.lang.String> files)
                  throws java.io.IOException

Throws:

java.io.IOException

crash

public void crash()
           throws java.io.IOException

Simulates a crash of OS or machine by overwriting unsynced files.

Throws:

java.io.IOException

clearCrash

public void clearCrash()

setMaxSizeInBytes

public void setMaxSizeInBytes(long maxSize)

getMaxSizeInBytes

public long getMaxSizeInBytes()

getMaxUsedSizeInBytes

public long getMaxUsedSizeInBytes()

Returns the peek actual storage used (bytes) in this directory.

resetMaxUsedSizeInBytes

public void resetMaxUsedSizeInBytes()
                             throws java.io.IOException

Throws:

java.io.IOException

setAssertNoDeleteOpenFile

public void setAssertNoDeleteOpenFile(boolean value)

Trip a test assert if there is an attempt to delete an open file.

getAssertNoDeleteOpenFile

public boolean getAssertNoDeleteOpenFile()

setRandomIOExceptionRate

public void setRandomIOExceptionRate(double rate)

If 0.0, no exceptions will be thrown. Else this should be a double 0.0 - 1.0. We will randomly throw an IOException on the first write to an OutputStream based on this probability.

getRandomIOExceptionRate

public double getRandomIOExceptionRate()

setRandomIOExceptionRateOnOpen

public void setRandomIOExceptionRateOnOpen(double rate)

If 0.0, no exceptions will be thrown during openInput and createOutput. Else this should be a double 0.0 - 1.0 and we will randomly throw an IOException in openInput and createOutput with this probability.

getRandomIOExceptionRateOnOpen

public double getRandomIOExceptionRateOnOpen()

getFileHandleCount

public long getFileHandleCount()

returns current open file handle count

deleteFile

public void deleteFile(java.lang.String name)
                throws java.io.IOException

Description copied from class: Directory

Removes an existing file in the directory. This method must throw either NoSuchFileException or FileNotFoundException if name points to a non-existing file.

Overrides:

deleteFile in class FilterDirectory

Parameters:

name - the name of an existing file.

Throws:

java.io.IOException - in case of I/O error

getOpenDeletedFiles

public java.util.Set<java.lang.String> getOpenDeletedFiles()

setFailOnCreateOutput

public void setFailOnCreateOutput(boolean v)

createOutput

public IndexOutput createOutput(java.lang.String name,
                                IOContext context)
                         throws java.io.IOException

Description copied from class: Directory

Creates a new, empty file in the directory and returns an IndexOutput instance for appending data to this file. This method must throw FileAlreadyExistsException if the file already exists.

Overrides:

createOutput in class FilterDirectory

Parameters:

name - the name of the file to create.

Throws:

java.io.IOException - in case of I/O error

createTempOutput

public IndexOutput createTempOutput(java.lang.String prefix,
                                    java.lang.String suffix,
                                    IOContext context)
                             throws java.io.IOException

Description copied from class: Directory

Creates a new, empty, temporary file in the directory and returns an IndexOutput instance for appending data to this file. The temporary file name (accessible via IndexOutput.getName()) will start with prefix, end with suffix and have a reserved file extension .tmp.

Overrides:

createTempOutput in class FilterDirectory

Throws:

java.io.IOException

setFailOnOpenInput

public void setFailOnOpenInput(boolean v)

openInput

public IndexInput openInput(java.lang.String name,
                            IOContext context)
                     throws java.io.IOException

Description copied from class: Directory

Opens a stream for reading an existing file. This method must throw either NoSuchFileException or FileNotFoundException if name points to a non-existing file.

Overrides:

openInput in class FilterDirectory

Parameters:

name - the name of an existing file.

Throws:

java.io.IOException - in case of I/O error

getRecomputedSizeInBytes

public final long getRecomputedSizeInBytes()
                                    throws java.io.IOException

Provided for testing purposes. Use sizeInBytes() instead.

Throws:

java.io.IOException

getRecomputedActualSizeInBytes

public final long getRecomputedActualSizeInBytes()
                                          throws java.io.IOException

Like getRecomputedSizeInBytes(), but, uses actual file lengths rather than buffer allocations (which are quantized up to nearest RAMOutputStream.BUFFER_SIZE (now 1024) bytes.

Throws:

java.io.IOException

setAssertNoUnrefencedFilesOnClose

public void setAssertNoUnrefencedFilesOnClose(boolean v)

close

public void close()
           throws java.io.IOException

Description copied from class: Directory

Closes the directory.

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Overrides:

close in class BaseDirectoryWrapper

Throws:

java.io.IOException

removeIndexOutput

public void removeIndexOutput(IndexOutput out,
                              java.lang.String name)

removeIndexInput

public void removeIndexInput(IndexInput in,
                             java.lang.String name)

failOn

public void failOn(MockDirectoryWrapper.Failure fail)

add a Failure object to the list of objects to be evaluated at every potential failure point

listAll

public java.lang.String[] listAll()
                           throws java.io.IOException

Description copied from class: Directory

Returns names of all files stored in this directory. The output must be in sorted (UTF-16, java's String.compareTo(java.lang.String)) order.

Overrides:

listAll in class FilterDirectory

Throws:

java.io.IOException - in case of I/O error

fileLength

public long fileLength(java.lang.String name)
                throws java.io.IOException

Description copied from class: Directory

Returns the byte length of a file in the directory. This method must throw either NoSuchFileException or FileNotFoundException if name points to a non-existing file.

Overrides:

fileLength in class FilterDirectory

Parameters:

name - the name of an existing file.

Throws:

java.io.IOException - in case of I/O error

obtainLock

public Lock obtainLock(java.lang.String name)
                throws java.io.IOException

Description copied from class: Directory

Acquires and returns a Lock for a file with the given name.

Overrides:

obtainLock in class FilterDirectory

Parameters:

name - the name of the lock file

Throws:

LockObtainFailedException - (optional specific exception) if the lock could not be obtained because it is currently held elsewhere.

java.io.IOException - if any i/o error occurs attempting to gain the lock

toString

public java.lang.String toString()

Overrides:

toString in class FilterDirectory

openChecksumInput

public final ChecksumIndexInput openChecksumInput(java.lang.String name,
                                                  IOContext context)
                                           throws java.io.IOException

Description copied from class: Directory

Opens a checksum-computing stream for reading an existing file. This method must throw either NoSuchFileException or FileNotFoundException if name points to a non-existing file.

Overrides:

openChecksumInput in class Directory

Parameters:

name - the name of an existing file.

Throws:

java.io.IOException - in case of I/O error

copyFrom

public final void copyFrom(Directory from,
                           java.lang.String src,
                           java.lang.String dest,
                           IOContext context)
                    throws java.io.IOException

Description copied from class: Directory

Copies an existing src file from directory from to a non-existent file dest in this directory.

Overrides:

copyFrom in class Directory

Throws:

java.io.IOException

ensureOpen

protected final void ensureOpen()
                         throws AlreadyClosedException

Description copied from class: Directory

Ensures this directory is still open.

Overrides:

ensureOpen in class Directory

Throws:

AlreadyClosedException - if this directory is closed.