alluxio.worker.file

Class FileDataManager

java.lang.Object

alluxio.worker.file.FileDataManager

@NotThreadSafe
public final class FileDataManager
extends Object

Responsible for storing files into under file system.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FileDataManager.PersistedFilesInfo Information about persisted files.

Constructor Summary

Constructors

Constructor and Description
FileDataManager(BlockWorker blockWorker, com.google.common.util.concurrent.RateLimiter persistenceRateLimiter, UfsManager ufsManager) Creates a new instance of FileDataManager.

Method Summary

Modifier and Type	Method and Description
void	clearPersistedFiles(List<Long> persistedFiles) Clears the given persisted files stored in mPersistedUfsFingerprints.
FileDataManager.PersistedFilesInfo	getPersistedFileInfos()
boolean	isFilePersisted(long fileId) Checks if the given file is persisted.
void	lockBlocks(long fileId, List<Long> blockIds) Locks all the blocks of a given file Id.
boolean	needPersistence(long fileId) Checks if the given file needs persistence.
void	persistFile(long fileId, List<Long> blockIds) Persists the blocks of a file into the under file system.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileDataManager

public FileDataManager(BlockWorker blockWorker,
                       com.google.common.util.concurrent.RateLimiter persistenceRateLimiter,
                       UfsManager ufsManager)

Creates a new instance of FileDataManager.

Parameters:

blockWorker - the block worker handle

persistenceRateLimiter - a per worker rate limiter to throttle async persistence

ufsManager - the ufs manager

Method Detail

needPersistence

public boolean needPersistence(long fileId)

Checks if the given file needs persistence.

Parameters:

fileId - the file id

Returns:

false if the file is being persisted, or is already persisted; otherwise true

isFilePersisted

public boolean isFilePersisted(long fileId)

Checks if the given file is persisted.

Parameters:

fileId - the file id

Returns:

true if the file is being persisted, false otherwise

lockBlocks

public void lockBlocks(long fileId,
                       List<Long> blockIds)
                throws IOException

Locks all the blocks of a given file Id.

Parameters:

fileId - the id of the file

blockIds - the ids of the file's blocks

Throws:

IOException

persistFile

public void persistFile(long fileId,
                        List<Long> blockIds)
                 throws AlluxioException,
                        IOException

Persists the blocks of a file into the under file system.

Parameters:

fileId - the id of the file

blockIds - the list of block ids

Throws:

AlluxioException

IOException

getPersistedFileInfos

public FileDataManager.PersistedFilesInfo getPersistedFileInfos()

Returns:

information about persisted files

clearPersistedFiles

public void clearPersistedFiles(List<Long> persistedFiles)

Clears the given persisted files stored in mPersistedUfsFingerprints.

Parameters:

persistedFiles - the list of persisted files to clear