alluxio.master.file

Class DefaultFileSystemMaster

java.lang.Object

alluxio.master.AbstractMaster

alluxio.master.file.DefaultFileSystemMaster

All Implemented Interfaces:

FileSystemMaster, JournalEntryIterable, JournalEntryStateMachine, Master, Server<Boolean>

@NotThreadSafe
public final class DefaultFileSystemMaster
extends AbstractMaster
implements FileSystemMaster

The master that handles all file system metadata management.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DefaultFileSystemMaster.Metrics Class that contains metrics for FileSystemMaster.

Field Summary

Fields inherited from class alluxio.master.AbstractMaster

mBackupManager, mClock, mPauseStateLock, mSafeModeManager, mStateChangeLock

Method Summary

Modifier and Type	Method and Description
List<AlluxioURI>	checkConsistency(AlluxioURI path, CheckConsistencyOptions options) Checks the consistency of the files and directories in the subtree under the path.
void	completeFile(AlluxioURI path, CompleteFileOptions options) Completes a file.
long	createDirectory(AlluxioURI path, CreateDirectoryOptions options) Creates a directory for a given path.
long	createFile(AlluxioURI path, CreateFileOptions options) Creates a file (not a directory) for a given path.
RpcContext	createRpcContext()
void	delete(AlluxioURI path, DeleteOptions options) Deletes a given path.
void	deleteAndJournal(RpcContext rpcContext, LockedInodePath inodePath, DeleteOptions deleteOptions) Deletes a given path.
void	free(AlluxioURI path, FreeOptions options) Frees or evicts all of the blocks of the file from alluxio storage.
Set<Class<? extends Server>>	getDependencies()
MountPointInfo	getDisplayMountPointInfo(AlluxioURI path) Gets the mount point information of an Alluxio path for display purpose.
List<FileBlockInfo>	getFileBlockInfoList(AlluxioURI path) Gets the FileBlockInfo for all blocks of a file.
long	getFileId(AlluxioURI path) Returns the file id for a given path.
FileInfo	getFileInfo(AlluxioURI path, GetStatusOptions options) Returns the FileInfo for a given path.
FileInfo	getFileInfo(long fileId) Returns the FileInfo for a given file id.
FileSystemMasterView	getFileSystemMasterView()
List<AlluxioURI>	getInAlluxioFiles()
List<AlluxioURI>	getInMemoryFiles()
Iterator<Journal.JournalEntry>	getJournalEntryIterator()
List<Long>	getLostFiles()
MountPointInfo	getMountPointInfo(AlluxioURI path) Gets the mount point information of an Alluxio path.
Map<String,MountPointInfo>	getMountTable()
String	getName()
long	getNewBlockIdForFile(AlluxioURI path) Gets a new block id for the next block of a given file to write to.
int	getNumberOfPaths()
int	getNumberOfPinnedFiles()
AlluxioURI	getPath(long fileId) Gets the path of a file with the given id.
PersistenceState	getPersistenceState(long fileId) Returns the persistence state for a file id.
Set<Long>	getPinIdList()
Map<String,org.apache.thrift.TProcessor>	getServices()
StartupConsistencyCheck	getStartupConsistencyCheck()
String	getUfsAddress()
UfsInfo	getUfsInfo(long mountId)
List<String>	getWhiteList()
List<WorkerInfo>	getWorkerInfoList()
List<FileInfo>	listStatus(AlluxioURI path, ListStatusOptions listStatusOptions) Returns a list of FileInfo for a given path.
long	loadMetadata(AlluxioURI path, LoadMetadataOptions options) Loads metadata for the object identified by the given path from UFS into Alluxio.
void	mount(AlluxioURI alluxioPath, AlluxioURI ufsPath, MountOptions options) Mounts a UFS path onto an Alluxio path.
void	processJournalEntry(Journal.JournalEntry entry) Applies a journal entry to the state machine.
long	reinitializeFile(AlluxioURI path, long blockSizeBytes, long ttl, TtlAction ttlAction) Reinitializes the blocks of an existing open file.
void	rename(AlluxioURI srcPath, AlluxioURI dstPath, RenameOptions options) Renames a file to a destination.
void	reportLostFile(long fileId) Reports a file as lost.
void	resetFile(long fileId) Resets a file.
void	resetState() Resets the journaled internal state of the state machine.
void	scheduleAsyncPersistence(AlluxioURI path) Schedules a file for async persistence.
void	setAttribute(AlluxioURI path, SetAttributeOptions options) Sets the file attribute.
void	start(Boolean isPrimary) Starts the Alluxio server.
void	stop() Stops the Alluxio server.
void	unmount(AlluxioURI alluxioPath) Unmounts a UFS path previously mounted onto an Alluxio path.
void	updateUfsMode(AlluxioURI ufsPath, UnderFileSystem.UfsMode ufsMode) Update the operation mode for the given ufs path under one or more mount points.
void	validateInodeBlocks(boolean repair) Checks the integrity of the inodes with respect to the blocks of the system.
FileSystemCommand	workerHeartbeat(long workerId, List<Long> persistedFiles, WorkerHeartbeatOptions options) Instructs a worker to persist the files.

Methods inherited from class alluxio.master.AbstractMaster

createJournalContext, getExecutorService

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.master.Master

createJournalContext

Method Detail

getServices

public Map<String,org.apache.thrift.TProcessor> getServices()

Specified by:

getServices in interface Server<Boolean>

Returns:

a map from service names to TProcessors that serve RPCs for this server

getName

public String getName()

Specified by:

getName in interface JournalEntryStateMachine

Specified by:

getName in interface Server<Boolean>

Returns:

the name of this journal entry state machine

getDependencies

public Set<Class<? extends Server>> getDependencies()

Specified by:

getDependencies in interface Server<Boolean>

Overrides:

getDependencies in class AbstractMaster

Returns:

the server dependencies

processJournalEntry

public void processJournalEntry(Journal.JournalEntry entry)
                         throws IOException

Description copied from interface: JournalEntryStateMachine

Applies a journal entry to the state machine.

Specified by:

processJournalEntry in interface JournalEntryStateMachine

Parameters:

entry - the entry to process to update the state of the state machine

Throws:

IOException

resetState

public void resetState()

Description copied from interface: JournalEntryStateMachine

Resets the journaled internal state of the state machine.

Specified by:

resetState in interface JournalEntryStateMachine

getJournalEntryIterator

public Iterator<Journal.JournalEntry> getJournalEntryIterator()

Specified by:

getJournalEntryIterator in interface JournalEntryIterable

Returns:

an Iterator that iterates all the journal entries

start

public void start(Boolean isPrimary)
           throws IOException

Description copied from interface: Server

Starts the Alluxio server.

Specified by:

start in interface Server<Boolean>

Overrides:

start in class AbstractMaster

Parameters:

isPrimary - the start options

Throws:

IOException

stop

public void stop()
          throws IOException

Description copied from interface: Server

Stops the Alluxio server. Here, anything created or started in #start(T) should be cleaned up and shutdown.

Specified by:

stop in interface Server<Boolean>

Overrides:

stop in class AbstractMaster

Throws:

IOException

validateInodeBlocks

public void validateInodeBlocks(boolean repair)
                         throws UnavailableException

Description copied from interface: FileSystemMaster

Checks the integrity of the inodes with respect to the blocks of the system.

Specified by:

validateInodeBlocks in interface FileSystemMaster

Parameters:

repair - if true, will attempt to repair the state of the system when inconsistencies are discovered

Throws:

UnavailableException - if the repair attempt fails

getStartupConsistencyCheck

public StartupConsistencyCheck getStartupConsistencyCheck()

Specified by:

getStartupConsistencyCheck in interface FileSystemMaster

Returns:

the status of the startup consistency check and inconsistent paths if it is complete

getFileId

public long getFileId(AlluxioURI path)
               throws AccessControlException,
                      UnavailableException

Description copied from interface: FileSystemMaster

Returns the file id for a given path. If the given path does not exist in Alluxio, the method attempts to load it from UFS.

This operation requires users to have READ permission of the path.

Specified by:

getFileId in interface FileSystemMaster

Parameters:

path - the path to get the file id for

Returns:

the file id for a given path, or -1 if there is no file at that path

Throws:

AccessControlException - if permission checking fails

UnavailableException

getFileInfo

public FileInfo getFileInfo(long fileId)
                     throws FileDoesNotExistException,
                            AccessControlException,
                            UnavailableException

Description copied from interface: FileSystemMaster

Returns the FileInfo for a given file id. This method is not user-facing but supposed to be called by other internal servers (e.g., block workers, lineage master, web UI).

Specified by:

getFileInfo in interface FileSystemMaster

Parameters:

fileId - the file id to get the FileInfo for

Returns:

the FileInfo for the given file

Throws:

FileDoesNotExistException - if the file does not exist

AccessControlException - if permission denied

UnavailableException

getFileInfo

public FileInfo getFileInfo(AlluxioURI path,
                            GetStatusOptions options)
                     throws FileDoesNotExistException,
                            InvalidPathException,
                            AccessControlException,
                            UnavailableException,
                            IOException

Description copied from interface: FileSystemMaster

Returns the FileInfo for a given path.

This operation requires users to have READ permission on the path.

Specified by:

getFileInfo in interface FileSystemMaster

Parameters:

path - the path to get the FileInfo for

options - the GetStatusOptions

Returns:

the FileInfo for the given file id

Throws:

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the file path is not valid

AccessControlException - if permission checking fails

UnavailableException

IOException

getPersistenceState

public PersistenceState getPersistenceState(long fileId)
                                     throws FileDoesNotExistException

Description copied from interface: FileSystemMaster

Returns the persistence state for a file id. This method is used by the lineage master.

Specified by:

getPersistenceState in interface FileSystemMaster

Parameters:

fileId - the file id

Returns:

the PersistenceState for the given file id

Throws:

FileDoesNotExistException - if the file does not exist

listStatus

public List<FileInfo> listStatus(AlluxioURI path,
                                 ListStatusOptions listStatusOptions)
                          throws AccessControlException,
                                 FileDoesNotExistException,
                                 InvalidPathException,
                                 UnavailableException

Description copied from interface: FileSystemMaster

Returns a list of FileInfo for a given path. If the given path is a file, the list only contains a single object. If it is a directory, the resulting list contains all direct children of the directory.

This operation requires users to have READ permission on the path, and also EXECUTE permission on the path if it is a directory.

Specified by:

listStatus in interface FileSystemMaster

Parameters:

path - the path to get the FileInfo list for

listStatusOptions - the ListStatusOptions

Returns:

the list of FileInfos

Throws:

AccessControlException - if permission checking fails

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the path is invalid

UnavailableException

getFileSystemMasterView

public FileSystemMasterView getFileSystemMasterView()

Specified by:

getFileSystemMasterView in interface FileSystemMaster

Returns:

a read-only view of the file system master

checkConsistency

public List<AlluxioURI> checkConsistency(AlluxioURI path,
                                         CheckConsistencyOptions options)
                                  throws AccessControlException,
                                         FileDoesNotExistException,
                                         InvalidPathException,
                                         IOException

Description copied from interface: FileSystemMaster

Checks the consistency of the files and directories in the subtree under the path.

Specified by:

checkConsistency in interface FileSystemMaster

Parameters:

path - the root of the subtree to check

options - the options to use for the checkConsistency method

Returns:

a list of paths in Alluxio which are not consistent with the under storage

Throws:

AccessControlException - if the permission checking fails

FileDoesNotExistException - if the path does not exist

InvalidPathException - if the path is invalid

IOException

completeFile

public void completeFile(AlluxioURI path,
                         CompleteFileOptions options)
                  throws BlockInfoException,
                         FileDoesNotExistException,
                         InvalidPathException,
                         InvalidFileSizeException,
                         FileAlreadyCompletedException,
                         AccessControlException,
                         UnavailableException

Description copied from interface: FileSystemMaster

Completes a file. After a file is completed, it cannot be written to.

This operation requires users to have WRITE permission on the path.

Specified by:

completeFile in interface FileSystemMaster

Parameters:

path - the file path to complete

options - the method options

Throws:

BlockInfoException - if a block information exception is encountered

FileDoesNotExistException - if the file does not exist

InvalidPathException - if an invalid path is encountered

InvalidFileSizeException - if an invalid file size is encountered

FileAlreadyCompletedException - if the file is already completed

AccessControlException - if permission checking fails

UnavailableException

createFile

public long createFile(AlluxioURI path,
                       CreateFileOptions options)
                throws AccessControlException,
                       InvalidPathException,
                       FileAlreadyExistsException,
                       BlockInfoException,
                       IOException,
                       FileDoesNotExistException

Description copied from interface: FileSystemMaster

Creates a file (not a directory) for a given path.

This operation requires WRITE permission on the parent of this path.

Specified by:

createFile in interface FileSystemMaster

Parameters:

path - the file to create

options - method options

Returns:

the id of the created file

Throws:

AccessControlException - if permission checking fails

InvalidPathException - if an invalid path is encountered

FileAlreadyExistsException - if the file already exists

BlockInfoException - if an invalid block information is encountered

FileDoesNotExistException - if the parent of the path does not exist and the recursive option is false

IOException

reinitializeFile

public long reinitializeFile(AlluxioURI path,
                             long blockSizeBytes,
                             long ttl,
                             TtlAction ttlAction)
                      throws InvalidPathException,
                             FileDoesNotExistException,
                             UnavailableException

Description copied from interface: FileSystemMaster

Reinitializes the blocks of an existing open file.

Specified by:

reinitializeFile in interface FileSystemMaster

Parameters:

path - the path to the file

blockSizeBytes - the new block size

ttl - the ttl

ttlAction - action to take after Ttl expiry

Returns:

the file id

Throws:

InvalidPathException - if the path is invalid

FileDoesNotExistException - if the path does not exist

UnavailableException

getNewBlockIdForFile

public long getNewBlockIdForFile(AlluxioURI path)
                          throws FileDoesNotExistException,
                                 InvalidPathException,
                                 AccessControlException

Description copied from interface: FileSystemMaster

Gets a new block id for the next block of a given file to write to.

This operation requires users to have WRITE permission on the path as this API is called when creating a new block for a file.

Specified by:

getNewBlockIdForFile in interface FileSystemMaster

Parameters:

path - the path of the file to get the next block id for

Returns:

the next block id for the given file

Throws:

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the given path is not valid

AccessControlException - if permission checking fails

getMountTable

public Map<String,MountPointInfo> getMountTable()

Specified by:

getMountTable in interface FileSystemMaster

Returns:

a copy of the current mount table

getDisplayMountPointInfo

public MountPointInfo getDisplayMountPointInfo(AlluxioURI path)
                                        throws InvalidPathException

Description copied from interface: FileSystemMaster

Gets the mount point information of an Alluxio path for display purpose.

Specified by:

getDisplayMountPointInfo in interface FileSystemMaster

Parameters:

path - an Alluxio path which must be a mount point

Returns:

the mount point information

Throws:

InvalidPathException

getMountPointInfo

public MountPointInfo getMountPointInfo(AlluxioURI path)
                                 throws InvalidPathException

Description copied from interface: FileSystemMaster

Gets the mount point information of an Alluxio path.

Specified by:

getMountPointInfo in interface FileSystemMaster

Parameters:

path - an Alluxio path which must be a mount point

Returns:

the mount point information

Throws:

InvalidPathException

getNumberOfPaths

public int getNumberOfPaths()

Specified by:

getNumberOfPaths in interface FileSystemMaster

Returns:

the number of files and directories

getNumberOfPinnedFiles

public int getNumberOfPinnedFiles()

Specified by:

getNumberOfPinnedFiles in interface FileSystemMaster

Returns:

the number of pinned files and directories

delete

public void delete(AlluxioURI path,
                   DeleteOptions options)
            throws IOException,
                   FileDoesNotExistException,
                   DirectoryNotEmptyException,
                   InvalidPathException,
                   AccessControlException

Description copied from interface: FileSystemMaster

Deletes a given path.

This operation requires user to have WRITE permission on the parent of the path.

Specified by:

delete in interface FileSystemMaster

Parameters:

path - the path to delete

options - method options

Throws:

FileDoesNotExistException - if the file does not exist

DirectoryNotEmptyException - if recursive is false and the file is a nonempty directory

InvalidPathException - if the path is invalid

AccessControlException - if permission checking fails

IOException

deleteAndJournal

public void deleteAndJournal(RpcContext rpcContext,
                             LockedInodePath inodePath,
                             DeleteOptions deleteOptions)
                      throws InvalidPathException,
                             FileDoesNotExistException,
                             IOException,
                             DirectoryNotEmptyException

Deletes a given path.

Writes to the journal. This method does not delete blocks. Instead, it adds blocks to the blockDeletionContext so that they can be deleted after the inode deletion journal entry has been written. We cannot delete blocks earlier because the inode deletion may fail, leaving us with inode containing deleted blocks.

Parameters:

rpcContext - the rpc context

inodePath - the path to delete

deleteOptions - the method options

Throws:

InvalidPathException - if the path is invalid

FileDoesNotExistException - if the file does not exist

DirectoryNotEmptyException - if recursive is false and the file is a nonempty directory

IOException

getFileBlockInfoList

public List<FileBlockInfo> getFileBlockInfoList(AlluxioURI path)
                                         throws FileDoesNotExistException,
                                                InvalidPathException,
                                                AccessControlException,
                                                UnavailableException

Description copied from interface: FileSystemMaster

Gets the FileBlockInfo for all blocks of a file. If path is a directory, an exception is thrown.

This operation requires the client user to have READ permission on the the path.

Specified by:

getFileBlockInfoList in interface FileSystemMaster

Parameters:

path - the path to get the info for

Returns:

a list of FileBlockInfo for all the blocks of the given path

Throws:

FileDoesNotExistException - if the file does not exist or path is a directory

InvalidPathException - if the path of the given file is invalid

AccessControlException - if permission checking fails

UnavailableException

getInAlluxioFiles

public List<AlluxioURI> getInAlluxioFiles()
                                   throws UnavailableException

Specified by:

getInAlluxioFiles in interface FileSystemMaster

Returns:

absolute paths of all in-Alluxio files

Throws:

UnavailableException

getInMemoryFiles

public List<AlluxioURI> getInMemoryFiles()
                                  throws UnavailableException

Specified by:

getInMemoryFiles in interface FileSystemMaster

Returns:

absolute paths of all in-memory files

Throws:

UnavailableException

createDirectory

public long createDirectory(AlluxioURI path,
                            CreateDirectoryOptions options)
                     throws InvalidPathException,
                            FileAlreadyExistsException,
                            IOException,
                            AccessControlException,
                            FileDoesNotExistException

Description copied from interface: FileSystemMaster

Creates a directory for a given path.

This operation requires the client user to have WRITE permission on the parent of the path.

Specified by:

createDirectory in interface FileSystemMaster

Parameters:

path - the path of the directory

options - method options

Returns:

the id of the created directory

Throws:

InvalidPathException - when the path is invalid

FileAlreadyExistsException - when there is already a file at path

AccessControlException - if permission checking fails

FileDoesNotExistException - if the parent of the path does not exist and the recursive option is false

IOException

rename

public void rename(AlluxioURI srcPath,
                   AlluxioURI dstPath,
                   RenameOptions options)
            throws FileAlreadyExistsException,
                   FileDoesNotExistException,
                   InvalidPathException,
                   IOException,
                   AccessControlException

Description copied from interface: FileSystemMaster

Renames a file to a destination.

This operation requires users to have WRITE permission on the parent of the src path, and WRITE permission on the parent of the dst path.

Specified by:

rename in interface FileSystemMaster

Parameters:

srcPath - the source path to rename

dstPath - the destination path to rename the file to

options - method options

Throws:

FileAlreadyExistsException - if the file already exists

FileDoesNotExistException - if a non-existent file is encountered

InvalidPathException - if an invalid path is encountered

AccessControlException - if permission checking fails

IOException

free

public void free(AlluxioURI path,
                 FreeOptions options)
          throws FileDoesNotExistException,
                 InvalidPathException,
                 AccessControlException,
                 UnexpectedAlluxioException,
                 IOException

Description copied from interface: FileSystemMaster

Frees or evicts all of the blocks of the file from alluxio storage. If the given file is a directory, and the 'recursive' flag is enabled, all descendant files will also be freed.

This operation requires users to have READ permission on the path.

Specified by:

free in interface FileSystemMaster

Parameters:

path - the path to free

options - options to free

Throws:

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the given path is invalid

AccessControlException - if permission checking fails

UnexpectedAlluxioException - if the file or directory can not be freed

IOException

getPath

public AlluxioURI getPath(long fileId)
                   throws FileDoesNotExistException

Description copied from interface: FileSystemMaster

Gets the path of a file with the given id.

Specified by:

getPath in interface FileSystemMaster

Parameters:

fileId - the id of the file to look up

Returns:

the path of the file

Throws:

FileDoesNotExistException - raise if the file does not exist

getPinIdList

public Set<Long> getPinIdList()

Specified by:

getPinIdList in interface FileSystemMaster

Returns:

the set of inode ids which are pinned

getUfsAddress

public String getUfsAddress()

Specified by:

getUfsAddress in interface FileSystemMaster

Returns:

the ufs address for this master

getUfsInfo

public UfsInfo getUfsInfo(long mountId)

Specified by:

getUfsInfo in interface FileSystemMaster

Parameters:

mountId - the mount id to query

Returns:

the ufs information for the given mount id

getWhiteList

public List<String> getWhiteList()

Specified by:

getWhiteList in interface FileSystemMaster

Returns:

the white list

getLostFiles

public List<Long> getLostFiles()

Specified by:

getLostFiles in interface FileSystemMaster

Returns:

all the files lost on the workers

reportLostFile

public void reportLostFile(long fileId)
                    throws FileDoesNotExistException,
                           UnavailableException

Description copied from interface: FileSystemMaster

Reports a file as lost.

Specified by:

reportLostFile in interface FileSystemMaster

Parameters:

fileId - the id of the file

Throws:

FileDoesNotExistException - if the file does not exist

UnavailableException

loadMetadata

public long loadMetadata(AlluxioURI path,
                         LoadMetadataOptions options)
                  throws BlockInfoException,
                         FileDoesNotExistException,
                         InvalidPathException,
                         InvalidFileSizeException,
                         FileAlreadyCompletedException,
                         IOException,
                         AccessControlException

Description copied from interface: FileSystemMaster

Loads metadata for the object identified by the given path from UFS into Alluxio.

This operation requires users to have WRITE permission on the path and its parent path if path is a file, or WRITE permission on the parent path if path is a directory.

Specified by:

loadMetadata in interface FileSystemMaster

Parameters:

path - the path for which metadata should be loaded

options - the load metadata options

Returns:

the file id of the loaded path

Throws:

BlockInfoException - if an invalid block size is encountered

FileDoesNotExistException - if there is no UFS path

InvalidPathException - if invalid path is encountered

InvalidFileSizeException - if invalid file size is encountered

FileAlreadyCompletedException - if the file is already completed

AccessControlException - if permission checking fails

IOException

mount

public void mount(AlluxioURI alluxioPath,
                  AlluxioURI ufsPath,
                  MountOptions options)
           throws FileAlreadyExistsException,
                  FileDoesNotExistException,
                  InvalidPathException,
                  IOException,
                  AccessControlException

Description copied from interface: FileSystemMaster

Mounts a UFS path onto an Alluxio path.

This operation requires users to have WRITE permission on the parent of the Alluxio path.

Specified by:

mount in interface FileSystemMaster

Parameters:

alluxioPath - the Alluxio path to mount to

ufsPath - the UFS path to mount

options - the mount options

Throws:

FileAlreadyExistsException - if the path to be mounted to already exists

FileDoesNotExistException - if the parent of the path to be mounted to does not exist

InvalidPathException - if an invalid path is encountered

AccessControlException - if the permission check fails

IOException

unmount

public void unmount(AlluxioURI alluxioPath)
             throws FileDoesNotExistException,
                    InvalidPathException,
                    IOException,
                    AccessControlException

Description copied from interface: FileSystemMaster

Unmounts a UFS path previously mounted onto an Alluxio path.

This operation requires users to have WRITE permission on the parent of the Alluxio path.

Specified by:

unmount in interface FileSystemMaster

Parameters:

alluxioPath - the Alluxio path to unmount, must be a mount point

Throws:

FileDoesNotExistException - if the path to be mounted does not exist

InvalidPathException - if the given path is not a mount point

AccessControlException - if the permission check fails

IOException

resetFile

public void resetFile(long fileId)
               throws UnexpectedAlluxioException,
                      FileDoesNotExistException,
                      InvalidPathException,
                      AccessControlException,
                      IOException

Description copied from interface: FileSystemMaster

Resets a file. It first free the whole file, and then reinitializes it.

Specified by:

resetFile in interface FileSystemMaster

Parameters:

fileId - the id of the file

Throws:

UnexpectedAlluxioException - if the file or directory can not be freed

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the path is invalid for the id of the file

AccessControlException - if permission checking fails

IOException

setAttribute

public void setAttribute(AlluxioURI path,
                         SetAttributeOptions options)
                  throws FileDoesNotExistException,
                         AccessControlException,
                         InvalidPathException,
                         IOException

Description copied from interface: FileSystemMaster

Sets the file attribute.

This operation requires users to have WRITE permission on the path. In addition, the client user must be a super user when setting the owner, and must be a super user or the owner when setting the group or permission.

Specified by:

setAttribute in interface FileSystemMaster

Parameters:

path - the path to set attribute for

options - attributes to be set, see SetAttributeOptions

Throws:

FileDoesNotExistException - if the file does not exist

AccessControlException - if permission checking fails

InvalidPathException - if the given path is invalid

IOException

scheduleAsyncPersistence

public void scheduleAsyncPersistence(AlluxioURI path)
                              throws AlluxioException,
                                     UnavailableException

Description copied from interface: FileSystemMaster

Schedules a file for async persistence.

Specified by:

scheduleAsyncPersistence in interface FileSystemMaster

Parameters:

path - the path of the file for persistence

Throws:

AlluxioException

UnavailableException

workerHeartbeat

public FileSystemCommand workerHeartbeat(long workerId,
                                         List<Long> persistedFiles,
                                         WorkerHeartbeatOptions options)
                                  throws FileDoesNotExistException,
                                         InvalidPathException,
                                         AccessControlException,
                                         IOException

Description copied from interface: FileSystemMaster

Instructs a worker to persist the files.

Needs WRITE permission on the list of files.

Specified by:

workerHeartbeat in interface FileSystemMaster

Parameters:

workerId - the id of the worker that heartbeats

persistedFiles - the files that persisted on the worker

options - the method options

Returns:

the command for persisting the blocks of a file

Throws:

FileDoesNotExistException - if the file does not exist

InvalidPathException - if the file path corresponding to the file id is invalid

AccessControlException - if permission checking fails

IOException

getWorkerInfoList

public List<WorkerInfo> getWorkerInfoList()
                                   throws UnavailableException

Specified by:

getWorkerInfoList in interface FileSystemMaster

Returns:

a list of WorkerInfo objects representing the workers in Alluxio

Throws:

UnavailableException

updateUfsMode

public void updateUfsMode(AlluxioURI ufsPath,
                          UnderFileSystem.UfsMode ufsMode)
                   throws InvalidPathException,
                          InvalidArgumentException,
                          UnavailableException,
                          AccessControlException

Description copied from interface: FileSystemMaster

Update the operation mode for the given ufs path under one or more mount points.

Specified by:

updateUfsMode in interface FileSystemMaster

Parameters:

ufsPath - the physical ufs path

ufsMode - the ufs operation mode

Throws:

InvalidPathException - if ufs path is not used by any mount point

InvalidArgumentException - if arguments for the method are invalid

UnavailableException

AccessControlException

createRpcContext

public RpcContext createRpcContext()
                            throws UnavailableException

Returns:

a context for executing an RPC

Throws:

UnavailableException