Modifier and Type | Method and Description |
---|---|
void |
BaseFileSystem.delete(AlluxioURI path) |
void |
FileSystem.delete(AlluxioURI path)
Convenience method for
FileSystem.delete(AlluxioURI, DeleteOptions) with default options. |
void |
BaseFileSystem.delete(AlluxioURI path,
DeleteOptions options) |
void |
FileSystem.delete(AlluxioURI path,
DeleteOptions options)
Deletes a file or a directory.
|
void |
BaseFileSystem.free(AlluxioURI path) |
void |
FileSystem.free(AlluxioURI path)
Convenience method for
FileSystem.free(AlluxioURI, FreeOptions) with default options. |
void |
BaseFileSystem.free(AlluxioURI path,
FreeOptions options) |
void |
FileSystem.free(AlluxioURI path,
FreeOptions options)
Evicts any data under the given path from Alluxio space, but does not delete the data from the
UFS.
|
URIStatus |
BaseFileSystem.getStatus(AlluxioURI path) |
URIStatus |
FileSystem.getStatus(AlluxioURI path)
Convenience method for
FileSystem.getStatus(AlluxioURI, GetStatusOptions) with default options. |
URIStatus |
BaseFileSystem.getStatus(AlluxioURI path,
GetStatusOptions options) |
URIStatus |
FileSystem.getStatus(AlluxioURI path,
GetStatusOptions options)
Gets the
URIStatus object that represents the metadata of an Alluxio path. |
List<URIStatus> |
BaseFileSystem.listStatus(AlluxioURI path) |
List<URIStatus> |
FileSystem.listStatus(AlluxioURI path)
Convenience method for
FileSystem.listStatus(AlluxioURI, ListStatusOptions) with default options. |
List<URIStatus> |
BaseFileSystem.listStatus(AlluxioURI path,
ListStatusOptions options) |
List<URIStatus> |
FileSystem.listStatus(AlluxioURI path,
ListStatusOptions options)
If the path is a directory, returns the
URIStatus of all the direct entries in it. |
void |
BaseFileSystem.loadMetadata(AlluxioURI path)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
FileSystem.loadMetadata(AlluxioURI path)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
BaseFileSystem.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
FileSystem.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
FileInStream |
BaseFileSystem.openFile(AlluxioURI path) |
FileInStream |
FileSystem.openFile(AlluxioURI path)
Convenience method for
FileSystem.openFile(AlluxioURI, OpenFileOptions) with default options. |
FileInStream |
BaseFileSystem.openFile(AlluxioURI path,
OpenFileOptions options) |
FileInStream |
FileSystem.openFile(AlluxioURI path,
OpenFileOptions options)
Opens a file for reading.
|
void |
BaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst) |
void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst)
Convenience method for
FileSystem.rename(AlluxioURI, AlluxioURI, RenameOptions) with default
options. |
void |
BaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options) |
void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options)
Renames an existing Alluxio path to another Alluxio path in Alluxio.
|
void |
BaseFileSystem.setAttribute(AlluxioURI path) |
void |
FileSystem.setAttribute(AlluxioURI path)
Convenience method for
FileSystem.setAttribute(AlluxioURI, SetAttributeOptions) with default
options. |
void |
BaseFileSystem.setAttribute(AlluxioURI path,
SetAttributeOptions options) |
void |
FileSystem.setAttribute(AlluxioURI path,
SetAttributeOptions options)
Sets any number of a path's attributes, such as TTL and pin status.
|
Modifier and Type | Method and Description |
---|---|
void |
KeyValueSystem.deleteStore(AlluxioURI uri)
Deletes a completed key-value store.
|
void |
BaseKeyValueSystem.deleteStore(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
long |
AlluxioLineage.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Convenience method for
AbstractLineageClient.createLineage(List, List, Job, CreateLineageOptions) with
default options. |
long |
AbstractLineageClient.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job,
CreateLineageOptions options) |
void |
LineageFileSystem.reportLostFile(AlluxioURI path)
Reports a file as lost.
|
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
DefaultFileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options) |
List<AlluxioURI> |
FileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of the files and directories in the subtree under the path.
|
void |
UfsSyncChecker.checkDirectory(InodeDirectory inode,
AlluxioURI alluxioUri)
Check if immediate children of directory are in sync with UFS.
|
void |
DefaultFileSystemMaster.completeFile(AlluxioURI path,
CompleteFileOptions options) |
void |
FileSystemMaster.completeFile(AlluxioURI path,
CompleteFileOptions options)
Completes a file.
|
long |
DefaultFileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryOptions options) |
long |
FileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryOptions options)
Creates a directory for a given path.
|
long |
DefaultFileSystemMaster.createFile(AlluxioURI path,
CreateFileOptions options) |
long |
FileSystemMaster.createFile(AlluxioURI path,
CreateFileOptions options)
Creates a file (not a directory) for a given path.
|
void |
DefaultFileSystemMaster.delete(AlluxioURI path,
DeleteOptions options) |
void |
FileSystemMaster.delete(AlluxioURI path,
DeleteOptions options)
Deletes a given path.
|
void |
DefaultFileSystemMaster.deleteAndJournal(RpcContext rpcContext,
LockedInodePath inodePath,
DeleteOptions deleteOptions)
Deletes a given path.
|
void |
DefaultFileSystemMaster.free(AlluxioURI path,
FreeOptions options) |
void |
FileSystemMaster.free(AlluxioURI path,
FreeOptions options)
Frees or evicts all of the blocks of the file from alluxio storage.
|
List<FileBlockInfo> |
DefaultFileSystemMaster.getFileBlockInfoList(AlluxioURI path) |
List<FileBlockInfo> |
FileSystemMaster.getFileBlockInfoList(AlluxioURI path)
Gets the
FileBlockInfo for all blocks of a file. |
FileInfo |
DefaultFileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusOptions options) |
FileInfo |
FileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusOptions options)
Returns the
FileInfo for a given path. |
FileInfo |
DefaultFileSystemMaster.getFileInfo(long fileId) |
FileInfo |
FileSystemMaster.getFileInfo(long fileId)
Returns the
FileInfo for a given file id. |
long |
DefaultFileSystemMaster.getNewBlockIdForFile(AlluxioURI path) |
long |
FileSystemMaster.getNewBlockIdForFile(AlluxioURI path)
Gets a new block id for the next block of a given file to write to.
|
AlluxioURI |
DefaultFileSystemMaster.getPath(long fileId) |
AlluxioURI |
FileSystemMaster.getPath(long fileId)
Gets the path of a file with the given id.
|
PersistenceState |
DefaultFileSystemMaster.getPersistenceState(long fileId) |
PersistenceState |
FileSystemMaster.getPersistenceState(long fileId)
Returns the persistence state for a file id.
|
List<FileInfo> |
DefaultFileSystemMaster.listStatus(AlluxioURI path,
ListStatusOptions listStatusOptions) |
List<FileInfo> |
FileSystemMaster.listStatus(AlluxioURI path,
ListStatusOptions listStatusOptions)
Returns a list of
FileInfo for a given path. |
long |
DefaultFileSystemMaster.loadMetadata(AlluxioURI path,
LoadMetadataOptions options) |
long |
FileSystemMaster.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Loads metadata for the object identified by the given path from UFS into Alluxio.
|
void |
DefaultFileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options) |
void |
FileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options)
Mounts a UFS path onto an Alluxio path.
|
long |
DefaultFileSystemMaster.reinitializeFile(AlluxioURI path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction) |
long |
FileSystemMaster.reinitializeFile(AlluxioURI path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction)
Reinitializes the blocks of an existing open file.
|
void |
DefaultFileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameOptions options) |
void |
FileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameOptions options)
Renames a file to a destination.
|
void |
DefaultFileSystemMaster.reportLostFile(long fileId) |
void |
FileSystemMaster.reportLostFile(long fileId)
Reports a file as lost.
|
void |
DefaultFileSystemMaster.resetFile(long fileId) |
void |
FileSystemMaster.resetFile(long fileId)
Resets a file.
|
void |
DefaultFileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeOptions options) |
void |
FileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeOptions options)
Sets the file attribute.
|
void |
DefaultFileSystemMaster.unmount(AlluxioURI alluxioPath) |
void |
FileSystemMaster.unmount(AlluxioURI alluxioPath)
Unmounts a UFS path previously mounted onto an Alluxio path.
|
FileSystemCommand |
DefaultFileSystemMaster.workerHeartbeat(long workerId,
List<Long> persistedFiles,
WorkerHeartbeatOptions options) |
FileSystemCommand |
FileSystemMaster.workerHeartbeat(long workerId,
List<Long> persistedFiles,
WorkerHeartbeatOptions options)
Instructs a worker to persist the files.
|
Constructor and Description |
---|
SafeUfsDeleter(MountTable mountTable,
List<Pair<AlluxioURI,LockedInodePath>> inodes,
DeleteOptions deleteOptions)
Creates a new instance of
SafeUfsDeleter . |
Modifier and Type | Method and Description |
---|---|
List<PersistFile> |
DefaultAsyncPersistHandler.pollFilesToPersist(long workerId)
Polls the files to send to the given worker for persistence.
|
List<PersistFile> |
AsyncPersistHandler.pollFilesToPersist(long workerId)
Polls the files for persistence on the given worker.
|
Modifier and Type | Method and Description |
---|---|
InodeTree.CreatePathResult |
InodeTree.createPath(RpcContext rpcContext,
LockedInodePath inodePath,
CreatePathOptions<?> options)
Creates a file or directory at path.
|
LockedInodePath |
LockedInodePath.createTempPathForExistingChild(Inode<?> child,
InodeTree.LockMode lockMode)
Constructs a temporary
LockedInodePath from an existing LockedInodePath , for
a direct child of the existing path. |
void |
InodeTree.deleteInode(RpcContext rpcContext,
LockedInodePath inodePath,
long opTimeMs,
DeleteOptions deleteOptions)
Deletes a single inode from the inode tree by removing it from the parent inode.
|
void |
InodeTree.ensureFullInodePath(LockedInodePath inodePath,
InodeTree.LockMode lockMode)
Attempts to extend an existing
LockedInodePath to reach the target inode (the last
inode for the full path). |
Inode<?> |
LockedInodePath.getAncestorInode()
Returns the closest ancestor of the target inode (last inode in the full path).
|
List<FileBlockInfo> |
FileSystemMasterView.getFileBlockInfoList(AlluxioURI path) |
long |
FileSystemMasterView.getFileId(AlluxioURI path)
Returns the file id for a given path.
|
FileInfo |
FileSystemMasterView.getFileInfo(long fileId)
Returns the
FileInfo for a given path. |
PersistenceState |
FileSystemMasterView.getFilePersistenceState(long fileId)
Returns the persistence state of a given file.
|
Inode<?> |
LockedInodePath.getInode() |
InodeFile |
LockedInodePath.getInodeFile() |
InodeDirectory |
LockedInodePath.getParentInodeDirectory() |
AlluxioURI |
InodeTree.getPath(Inode<?> inode)
Returns the path for a particular inode.
|
AlluxioURI |
FileSystemMasterView.getPath(long fileId)
Gets the path of a file with the given id.
|
LockedInodePath |
InodeTree.lockChildPath(LockedInodePath inodePath,
InodeTree.LockMode lockMode,
Inode<?> childInode,
String[] pathComponents)
Lock from a specific poiint in the tree to the immediate child, and return a lockedInodePath.
|
LockedInodePath |
InodeTree.lockFullInodePath(AlluxioURI path,
InodeTree.LockMode lockMode)
Locks existing inodes on the specified path, in the specified
InodeTree.LockMode . |
LockedInodePath |
InodeTree.lockFullInodePath(long id,
InodeTree.LockMode lockMode)
Locks existing inodes on the path to the inode specified by an id, in the specified
InodeTree.LockMode . |
long |
InodeTree.reinitializeFile(LockedInodePath inodePath,
long blockSizeBytes,
long ttl,
TtlAction ttlAction)
Reinitializes the block size and TTL of an existing open file.
|
void |
InodeTree.setPinned(LockedInodePath inodePath,
boolean pinned)
Sets the pinned state of an inode.
|
void |
InodeTree.setPinned(LockedInodePath inodePath,
boolean pinned,
long opTimeMs)
Sets the pinned state of an inode.
|
void |
InodeTree.syncPersistDirectory(RpcContext rpcContext,
InodeDirectory dir)
Synchronously persists an
InodeDirectory to the UFS. |
Modifier and Type | Method and Description |
---|---|
void |
DefaultKeyValueMaster.completePartition(AlluxioURI path,
PartitionInfo info) |
void |
KeyValueMaster.completePartition(AlluxioURI path,
PartitionInfo info)
Marks a partition complete and adds it to an incomplete key-value store.
|
void |
DefaultKeyValueMaster.completeStore(AlluxioURI path) |
void |
KeyValueMaster.completeStore(AlluxioURI path)
Marks a key-value store complete.
|
void |
DefaultKeyValueMaster.deleteStore(AlluxioURI uri) |
void |
KeyValueMaster.deleteStore(AlluxioURI uri)
Deletes a completed key-value store.
|
List<PartitionInfo> |
DefaultKeyValueMaster.getPartitionInfo(AlluxioURI path) |
List<PartitionInfo> |
KeyValueMaster.getPartitionInfo(AlluxioURI path)
Gets a list of partitions of a given key-value store.
|
void |
DefaultKeyValueMaster.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri) |
void |
KeyValueMaster.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri)
Merges one completed key-value store to another completed key-value store.
|
Modifier and Type | Method and Description |
---|---|
long |
LineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Creates a lineage.
|
long |
DefaultLineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job) |
List<LineageInfo> |
LineageMaster.getLineageInfoList() |
List<LineageInfo> |
DefaultLineageMaster.getLineageInfoList() |
long |
LineageMaster.reinitializeFile(String path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction)
Reinitializes the file when the file is lost or not completed.
|
long |
DefaultLineageMaster.reinitializeFile(String path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction) |
void |
LineageMaster.reportLostFile(String path)
Reports a file as lost.
|
void |
DefaultLineageMaster.reportLostFile(String path) |
Modifier and Type | Method and Description |
---|---|
static List<Long> |
LineageStateUtils.getLostFiles(Lineage lineage,
FileSystemMasterView fileSystemMasterView) |
static boolean |
LineageStateUtils.isCompleted(Lineage lineage,
FileSystemMasterView fileSystemMasterView)
Checks if all the output files of the given lineage are completed.
|
static boolean |
LineageStateUtils.isInCheckpointing(Lineage lineage,
FileSystemMasterView fileSystemMasterView) |
static boolean |
LineageStateUtils.isPersisted(Lineage lineage,
FileSystemMasterView fileSystemMasterView) |
static boolean |
LineageStateUtils.needRecompute(Lineage lineage,
FileSystemMasterView fileSystemMasterView) |
Constructor and Description |
---|
SwiftUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new Swift
UnderFileSystem . |
Copyright © 2023. All Rights Reserved.