Modifier and Type | Field and Description |
---|---|
static AlluxioURI |
AlluxioURI.EMPTY_URI |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
AlluxioURI.getParent()
Get the parent of this
AlluxioURI or null if at root. |
AlluxioURI |
AlluxioURI.join(AlluxioURI suffix)
Append additional path elements to the end of an
AlluxioURI . |
AlluxioURI |
AlluxioURI.join(String suffix)
Append additional path elements to the end of an
AlluxioURI . |
Modifier and Type | Method and Description |
---|---|
int |
AlluxioURI.compareTo(AlluxioURI other) |
AlluxioURI |
AlluxioURI.join(AlluxioURI suffix)
Append additional path elements to the end of an
AlluxioURI . |
Constructor and Description |
---|
AlluxioURI(AlluxioURI parent,
AlluxioURI child)
Resolves a child
AlluxioURI against a parent AlluxioURI . |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemShellUtils.getAlluxioURIs(FileSystem alluxioClient,
AlluxioURI inputURI)
Gets all the
AlluxioURI s that match inputURI. |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemShellUtils.getAlluxioURIs(FileSystem alluxioClient,
AlluxioURI inputURI)
Gets all the
AlluxioURI s that match inputURI. |
Modifier and Type | Method and Description |
---|---|
protected void |
CheckConsistencyCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChownCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
UnpinCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
UnmountCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
RmCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LoadCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
CatCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
PinCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
HeadCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
TailCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
FreeCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
DuCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
TouchCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
LsCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LocationCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
SetTtlCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
UnsetTtlCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
StatCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChmodCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
PersistCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChgrpCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
ReportCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChecksumCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
AbstractFileSystemCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl)
Run the command for a particular URI that does not contain wildcard in its path.
|
protected void |
AbstractFileSystemCommand.runWildCardCmd(AlluxioURI wildCardPath,
org.apache.commons.cli.CommandLine cl)
Run the command for a particular URI that may contain wildcard in its path.
|
static void |
FileSystemCommandUtils.setPinned(FileSystem fs,
AlluxioURI path,
boolean pinned)
Sets pin state for the input path.
|
static void |
FileSystemCommandUtils.setTtl(FileSystem fs,
AlluxioURI path,
long ttlMs,
TtlAction ttlAction)
Sets a new TTL value or unsets an existing TTL value for file at path.
|
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
FileOutStream.mUri |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemUtils.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
List<AlluxioURI> |
RetryHandlingFileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options) |
List<AlluxioURI> |
FileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemUtils.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
List<AlluxioURI> |
RetryHandlingFileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options) |
List<AlluxioURI> |
FileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
void |
RetryHandlingFileSystemMasterClient.completeFile(AlluxioURI path,
CompleteFileOptions options) |
void |
FileSystemMasterClient.completeFile(AlluxioURI path,
CompleteFileOptions options)
Marks a file as completed.
|
void |
BaseFileSystem.createDirectory(AlluxioURI path) |
void |
FileSystem.createDirectory(AlluxioURI path)
Convenience method for
FileSystem.createDirectory(AlluxioURI, CreateDirectoryOptions) with
default options. |
void |
BaseFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryOptions options) |
void |
RetryHandlingFileSystemMasterClient.createDirectory(AlluxioURI path,
CreateDirectoryOptions options) |
void |
FileSystem.createDirectory(AlluxioURI path,
CreateDirectoryOptions options)
Creates a directory.
|
void |
FileSystemMasterClient.createDirectory(AlluxioURI path,
CreateDirectoryOptions options)
Creates a new directory.
|
FileOutStream |
BaseFileSystem.createFile(AlluxioURI path) |
FileOutStream |
FileSystem.createFile(AlluxioURI path)
Convenience method for
FileSystem.createFile(AlluxioURI, CreateFileOptions) with default options. |
FileOutStream |
BaseFileSystem.createFile(AlluxioURI path,
CreateFileOptions options) |
void |
RetryHandlingFileSystemMasterClient.createFile(AlluxioURI path,
CreateFileOptions options) |
FileOutStream |
FileSystem.createFile(AlluxioURI path,
CreateFileOptions options)
Creates a file.
|
void |
FileSystemMasterClient.createFile(AlluxioURI path,
CreateFileOptions options)
Creates a new file.
|
void |
BaseFileSystem.delete(AlluxioURI path) |
void |
FileSystem.delete(AlluxioURI path)
Convenience method for
FileSystem.delete(AlluxioURI, DeleteOptions) with default options. |
void |
BaseFileSystem.delete(AlluxioURI path,
DeleteOptions options) |
void |
RetryHandlingFileSystemMasterClient.delete(AlluxioURI path,
DeleteOptions options) |
void |
FileSystem.delete(AlluxioURI path,
DeleteOptions options)
Deletes a file or a directory.
|
void |
FileSystemMasterClient.delete(AlluxioURI path,
DeleteOptions options)
Deletes a file or a directory.
|
boolean |
BaseFileSystem.exists(AlluxioURI path) |
boolean |
FileSystem.exists(AlluxioURI path)
Convenience method for
FileSystem.exists(AlluxioURI, ExistsOptions) with default options. |
boolean |
BaseFileSystem.exists(AlluxioURI path,
ExistsOptions options) |
boolean |
FileSystem.exists(AlluxioURI path,
ExistsOptions options)
Checks whether a path exists in Alluxio space.
|
void |
BaseFileSystem.free(AlluxioURI path) |
void |
FileSystem.free(AlluxioURI path)
Convenience method for
FileSystem.free(AlluxioURI, FreeOptions) with default options. |
void |
BaseFileSystem.free(AlluxioURI path,
FreeOptions options) |
void |
RetryHandlingFileSystemMasterClient.free(AlluxioURI path,
FreeOptions options) |
void |
FileSystem.free(AlluxioURI path,
FreeOptions options)
Evicts any data under the given path from Alluxio space, but does not delete the data from the
UFS.
|
void |
FileSystemMasterClient.free(AlluxioURI path,
FreeOptions options)
Frees a file.
|
long |
RetryHandlingFileSystemMasterClient.getNewBlockIdForFile(AlluxioURI path) |
long |
FileSystemMasterClient.getNewBlockIdForFile(AlluxioURI path) |
URIStatus |
BaseFileSystem.getStatus(AlluxioURI path) |
URIStatus |
FileSystem.getStatus(AlluxioURI path)
Convenience method for
FileSystem.getStatus(AlluxioURI, GetStatusOptions) with default options. |
URIStatus |
BaseFileSystem.getStatus(AlluxioURI path,
GetStatusOptions options) |
URIStatus |
RetryHandlingFileSystemMasterClient.getStatus(AlluxioURI path,
GetStatusOptions options) |
URIStatus |
FileSystem.getStatus(AlluxioURI path,
GetStatusOptions options)
Gets the
URIStatus object that represents the metadata of an Alluxio path. |
URIStatus |
FileSystemMasterClient.getStatus(AlluxioURI path,
GetStatusOptions options) |
List<URIStatus> |
BaseFileSystem.listStatus(AlluxioURI path) |
List<URIStatus> |
FileSystem.listStatus(AlluxioURI path)
Convenience method for
FileSystem.listStatus(AlluxioURI, ListStatusOptions) with default options. |
List<URIStatus> |
BaseFileSystem.listStatus(AlluxioURI path,
ListStatusOptions options) |
List<URIStatus> |
RetryHandlingFileSystemMasterClient.listStatus(AlluxioURI path,
ListStatusOptions options) |
List<URIStatus> |
FileSystem.listStatus(AlluxioURI path,
ListStatusOptions options)
If the path is a directory, returns the
URIStatus of all the direct entries in it. |
List<URIStatus> |
FileSystemMasterClient.listStatus(AlluxioURI path,
ListStatusOptions options) |
void |
BaseFileSystem.loadMetadata(AlluxioURI path)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
FileSystem.loadMetadata(AlluxioURI path)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
BaseFileSystem.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
RetryHandlingFileSystemMasterClient.loadMetadata(AlluxioURI path,
LoadMetadataOptions options) |
void |
FileSystem.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
FileSystemMasterClient.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Deprecated.
since version 1.1 and will be removed in version 2.0
|
void |
BaseFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath) |
void |
FileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath)
Convenience method for
FileSystem.mount(AlluxioURI, AlluxioURI, MountOptions) with default
options. |
void |
BaseFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options) |
void |
RetryHandlingFileSystemMasterClient.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options) |
void |
FileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options)
Mounts a UFS subtree to the given Alluxio path.
|
void |
FileSystemMasterClient.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options)
Mounts the given UFS path under the given Alluxio path.
|
FileInStream |
BaseFileSystem.openFile(AlluxioURI path) |
FileInStream |
FileSystem.openFile(AlluxioURI path)
Convenience method for
FileSystem.openFile(AlluxioURI, OpenFileOptions) with default options. |
FileInStream |
BaseFileSystem.openFile(AlluxioURI path,
OpenFileOptions options) |
FileInStream |
FileSystem.openFile(AlluxioURI path,
OpenFileOptions options)
Opens a file for reading.
|
static void |
FileSystemUtils.persistFile(FileSystem fs,
AlluxioURI uri)
Persists the given file to the under file system.
|
void |
BaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst) |
void |
RetryHandlingFileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst) |
void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst)
Convenience method for
FileSystem.rename(AlluxioURI, AlluxioURI, RenameOptions) with default
options. |
void |
FileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst)
Renames a file or a directory.
|
void |
BaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options) |
void |
RetryHandlingFileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options) |
void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options)
Renames an existing Alluxio path to another Alluxio path in Alluxio.
|
void |
FileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst,
RenameOptions options)
Renames a file or a directory.
|
void |
RetryHandlingFileSystemMasterClient.scheduleAsyncPersist(AlluxioURI path) |
void |
FileSystemMasterClient.scheduleAsyncPersist(AlluxioURI path)
Schedules the async persistence of the given file.
|
void |
BaseFileSystem.setAttribute(AlluxioURI path) |
void |
FileSystem.setAttribute(AlluxioURI path)
Convenience method for
FileSystem.setAttribute(AlluxioURI, SetAttributeOptions) with default
options. |
void |
BaseFileSystem.setAttribute(AlluxioURI path,
SetAttributeOptions options) |
void |
RetryHandlingFileSystemMasterClient.setAttribute(AlluxioURI path,
SetAttributeOptions options) |
void |
FileSystem.setAttribute(AlluxioURI path,
SetAttributeOptions options)
Sets any number of a path's attributes, such as TTL and pin status.
|
void |
FileSystemMasterClient.setAttribute(AlluxioURI path,
SetAttributeOptions options)
Sets the file or directory attributes.
|
void |
BaseFileSystem.unmount(AlluxioURI path) |
void |
RetryHandlingFileSystemMasterClient.unmount(AlluxioURI alluxioPath) |
void |
FileSystem.unmount(AlluxioURI path)
Convenience method for
FileSystem.unmount(AlluxioURI, UnmountOptions) with default options. |
void |
FileSystemMasterClient.unmount(AlluxioURI alluxioPath)
Unmounts the given Alluxio path.
|
void |
BaseFileSystem.unmount(AlluxioURI path,
UnmountOptions options) |
void |
FileSystem.unmount(AlluxioURI path,
UnmountOptions options)
Unmounts a UFS subtree identified by the given Alluxio path.
|
void |
RetryHandlingFileSystemMasterClient.updateUfsMode(AlluxioURI ufsUri,
UpdateUfsModeOptions options) |
void |
FileSystemMasterClient.updateUfsMode(AlluxioURI ufsUri,
UpdateUfsModeOptions options)
Updates the operation mode for the given ufs path.
|
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri)
Shortcut for
waitCompleted(fs, uri, -1, TimeUnit.MILLISECONDS) , i.e., wait for an
indefinite amount of time. |
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri,
long timeout,
TimeUnit tunit)
Waits for a file to be marked as completed.
|
Constructor and Description |
---|
FileOutStream(AlluxioURI path,
OutStreamOptions options,
FileSystemContext context)
Creates a new file output stream.
|
Modifier and Type | Method and Description |
---|---|
void |
KeyValueMasterClient.completePartition(AlluxioURI path,
PartitionInfo info)
Marks a partition complete and adds it to an incomplete key-value store.
|
void |
KeyValueMasterClient.completeStore(AlluxioURI path)
Marks a key-value store complete.
|
static KeyValuePartitionWriter |
KeyValuePartitionWriter.Factory.create(AlluxioURI uri)
Factory method to create a
KeyValuePartitionWriter instance that writes key-value
data to a new partition file in Alluxio. |
static KeyValuePartitionReader |
KeyValuePartitionReader.Factory.create(AlluxioURI uri)
Factory method to create a
KeyValuePartitionReader given the AlluxioURI of a
key-value partition. |
KeyValueStoreWriter |
KeyValueSystem.createStore(AlluxioURI uri)
Gets a writer to create a new key-value store.
|
KeyValueStoreWriter |
BaseKeyValueSystem.createStore(AlluxioURI uri) |
void |
KeyValueMasterClient.createStore(AlluxioURI path)
Creates a new key-value store.
|
void |
KeyValueSystem.deleteStore(AlluxioURI uri)
Deletes a completed key-value store.
|
void |
BaseKeyValueSystem.deleteStore(AlluxioURI uri) |
void |
KeyValueMasterClient.deleteStore(AlluxioURI path)
Deletes a completed key-value store.
|
List<PartitionInfo> |
KeyValueMasterClient.getPartitionInfo(AlluxioURI path)
Gets a list of partitions of a given key-value store.
|
void |
KeyValueSystem.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri)
Merges one completed key-value store to another completed key-value store.
|
void |
BaseKeyValueSystem.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri) |
KeyValueStoreReader |
KeyValueSystem.openStore(AlluxioURI uri)
Gets a reader to access a key-value store.
|
KeyValueStoreReader |
BaseKeyValueSystem.openStore(AlluxioURI uri) |
void |
KeyValueSystem.renameStore(AlluxioURI oldUri,
AlluxioURI newUri)
Rename a completed key-value store.
|
void |
BaseKeyValueSystem.renameStore(AlluxioURI oldUri,
AlluxioURI newUri) |
void |
KeyValueMasterClient.renameStore(AlluxioURI oldPath,
AlluxioURI newPath)
Renames a completed key-value store.
|
Modifier and Type | Method and Description |
---|---|
FileOutStream |
LineageFileSystem.createFile(AlluxioURI path,
CreateFileOptions options)
Gets the output stream for lineage job.
|
void |
LineageFileSystem.reportLostFile(AlluxioURI path)
Reports a file as lost.
|
Modifier and Type | Method and Description |
---|---|
long |
AlluxioLineage.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Convenience method for
AbstractLineageClient.createLineage(List, List, Job, CreateLineageOptions) with
default options. |
long |
AlluxioLineage.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Convenience method for
AbstractLineageClient.createLineage(List, List, Job, CreateLineageOptions) with
default options. |
long |
AbstractLineageClient.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job,
CreateLineageOptions options) |
long |
AbstractLineageClient.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job,
CreateLineageOptions options) |
Constructor and Description |
---|
DummyFileOutputStream(AlluxioURI path,
OutStreamOptions options)
Constructs a new dummy file output stream.
|
LineageFileOutStream(FileSystemContext context,
AlluxioURI path,
OutStreamOptions options)
Creates a new file output stream when lineage is enabled.
|
Constructor and Description |
---|
BasicNonByteBufferOperations(AlluxioURI filePath,
ReadType readType,
WriteType writeType,
boolean deleteIfExists,
int length) |
BasicOperations(AlluxioURI filePath,
ReadType readType,
WriteType writeType) |
Constructor and Description |
---|
KeyValueStoreOperations(AlluxioURI storeUri) |
SameKeyValueStoresTest(AlluxioURI storeUri1,
AlluxioURI storeUri2) |
Constructor and Description |
---|
FileAlreadyExistsException(AlluxioURI path)
Constructs a new exception reporting that the given path already exists.
|
FileDoesNotExistException(AlluxioURI path)
Constructs a new exception stating that the given path does not exist.
|
Constructor and Description |
---|
HdfsFileInputStream(FileSystemContext context,
AlluxioURI uri,
org.apache.hadoop.fs.FileSystem.Statistics stats)
Constructs a new stream for reading a file from HDFS.
|
Modifier and Type | Method and Description |
---|---|
static AlluxioURI |
KeyValueOutputFormat.getJobOutputURI(org.apache.hadoop.mapreduce.JobContext jobContext) |
static AlluxioURI |
KeyValueOutputFormat.getTaskOutputURI(org.apache.hadoop.mapreduce.TaskAttemptContext taskContext) |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
DefaultFileSystemMaster.getPath(long fileId) |
AlluxioURI |
FileSystemMaster.getPath(long fileId)
Gets the path of a file with the given id.
|
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
DefaultFileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options) |
List<AlluxioURI> |
FileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of the files and directories in the subtree under the path.
|
List<AlluxioURI> |
DefaultFileSystemMaster.getInAlluxioFiles() |
List<AlluxioURI> |
FileSystemMaster.getInAlluxioFiles() |
List<AlluxioURI> |
StartupConsistencyCheck.getInconsistentUris() |
List<AlluxioURI> |
DefaultFileSystemMaster.getInMemoryFiles() |
List<AlluxioURI> |
FileSystemMaster.getInMemoryFiles() |
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
DefaultFileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options) |
List<AlluxioURI> |
FileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyOptions options)
Checks the consistency of the files and directories in the subtree under the path.
|
void |
UfsSyncChecker.checkDirectory(InodeDirectory inode,
AlluxioURI alluxioUri)
Check if immediate children of directory are in sync with UFS.
|
void |
DefaultFileSystemMaster.completeFile(AlluxioURI path,
CompleteFileOptions options) |
void |
FileSystemMaster.completeFile(AlluxioURI path,
CompleteFileOptions options)
Completes a file.
|
long |
DefaultFileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryOptions options) |
long |
FileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryOptions options)
Creates a directory for a given path.
|
long |
DefaultFileSystemMaster.createFile(AlluxioURI path,
CreateFileOptions options) |
long |
FileSystemMaster.createFile(AlluxioURI path,
CreateFileOptions options)
Creates a file (not a directory) for a given path.
|
void |
DefaultFileSystemMaster.delete(AlluxioURI path,
DeleteOptions options) |
void |
FileSystemMaster.delete(AlluxioURI path,
DeleteOptions options)
Deletes a given path.
|
void |
NoopUfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode) |
void |
UfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode)
Deletes a path if not covered by a recursive delete.
|
void |
SafeUfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode) |
void |
DefaultFileSystemMaster.free(AlluxioURI path,
FreeOptions options) |
void |
FileSystemMaster.free(AlluxioURI path,
FreeOptions options)
Frees or evicts all of the blocks of the file from alluxio storage.
|
MountPointInfo |
DefaultFileSystemMaster.getDisplayMountPointInfo(AlluxioURI path) |
MountPointInfo |
FileSystemMaster.getDisplayMountPointInfo(AlluxioURI path)
Gets the mount point information of an Alluxio path for display purpose.
|
List<FileBlockInfo> |
DefaultFileSystemMaster.getFileBlockInfoList(AlluxioURI path) |
List<FileBlockInfo> |
FileSystemMaster.getFileBlockInfoList(AlluxioURI path)
Gets the
FileBlockInfo for all blocks of a file. |
long |
DefaultFileSystemMaster.getFileId(AlluxioURI path) |
long |
FileSystemMaster.getFileId(AlluxioURI path)
Returns the file id for a given path.
|
FileInfo |
DefaultFileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusOptions options) |
FileInfo |
FileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusOptions options)
Returns the
FileInfo for a given path. |
MountPointInfo |
DefaultFileSystemMaster.getMountPointInfo(AlluxioURI path) |
MountPointInfo |
FileSystemMaster.getMountPointInfo(AlluxioURI path)
Deprecated.
will be removed after 2.0
|
long |
DefaultFileSystemMaster.getNewBlockIdForFile(AlluxioURI path) |
long |
FileSystemMaster.getNewBlockIdForFile(AlluxioURI path)
Gets a new block id for the next block of a given file to write to.
|
boolean |
UfsSyncChecker.isDirectoryInSync(AlluxioURI alluxioUri)
Based on directories for which
UfsSyncChecker.checkDirectory(InodeDirectory, AlluxioURI) was called, this method
returns whether any un-synced entries were found. |
List<FileInfo> |
DefaultFileSystemMaster.listStatus(AlluxioURI path,
ListStatusOptions listStatusOptions) |
List<FileInfo> |
FileSystemMaster.listStatus(AlluxioURI path,
ListStatusOptions listStatusOptions)
Returns a list of
FileInfo for a given path. |
long |
DefaultFileSystemMaster.loadMetadata(AlluxioURI path,
LoadMetadataOptions options) |
long |
FileSystemMaster.loadMetadata(AlluxioURI path,
LoadMetadataOptions options)
Loads metadata for the object identified by the given path from UFS into Alluxio.
|
void |
DefaultFileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options) |
void |
FileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountOptions options)
Mounts a UFS path onto an Alluxio path.
|
long |
DefaultFileSystemMaster.reinitializeFile(AlluxioURI path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction) |
long |
FileSystemMaster.reinitializeFile(AlluxioURI path,
long blockSizeBytes,
long ttl,
TtlAction ttlAction)
Reinitializes the blocks of an existing open file.
|
void |
DefaultFileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameOptions options) |
void |
FileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameOptions options)
Renames a file to a destination.
|
void |
DefaultFileSystemMaster.scheduleAsyncPersistence(AlluxioURI path) |
void |
FileSystemMaster.scheduleAsyncPersistence(AlluxioURI path)
Schedules a file for async persistence.
|
void |
DefaultFileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeOptions options) |
void |
FileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeOptions options)
Sets the file attribute.
|
FileSystemMasterAuditContext |
FileSystemMasterAuditContext.setDstPath(AlluxioURI dstPath)
Sets mDstPath field.
|
FileSystemMasterAuditContext |
FileSystemMasterAuditContext.setSrcPath(AlluxioURI srcPath)
Sets mSrcPath field.
|
void |
DefaultFileSystemMaster.unmount(AlluxioURI alluxioPath) |
void |
FileSystemMaster.unmount(AlluxioURI alluxioPath)
Unmounts a UFS path previously mounted onto an Alluxio path.
|
void |
DefaultFileSystemMaster.updateUfsMode(AlluxioURI ufsPath,
UnderFileSystem.UfsMode ufsMode) |
void |
FileSystemMaster.updateUfsMode(AlluxioURI ufsPath,
UnderFileSystem.UfsMode ufsMode)
Update the operation mode for the given ufs path under one or more mount points.
|
Modifier and Type | Method and Description |
---|---|
static StartupConsistencyCheck |
StartupConsistencyCheck.complete(List<AlluxioURI> inconsistentUris) |
Constructor and Description |
---|
SafeUfsDeleter(MountTable mountTable,
List<Pair<AlluxioURI,LockedInodePath>> inodes,
DeleteOptions deleteOptions)
Creates a new instance of
SafeUfsDeleter . |
Modifier and Type | Method and Description |
---|---|
void |
DefaultAsyncPersistHandler.scheduleAsyncPersistence(AlluxioURI path) |
void |
AsyncPersistHandler.scheduleAsyncPersistence(AlluxioURI path)
Schedules a file for async persistence.
|
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
LockedInodePath.mUri |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
LockingScheme.getPath() |
AlluxioURI |
InodeTree.getPath(Inode<?> inode)
Returns the path for a particular inode.
|
AlluxioURI |
FileSystemMasterView.getPath(long fileId)
Gets the path of a file with the given id.
|
AlluxioURI |
LockedInodePath.getUri() |
AlluxioURI |
MountTable.Resolution.getUri() |
Modifier and Type | Method and Description |
---|---|
void |
MountTable.add(AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountOptions options)
Mounts the given UFS path at the given Alluxio path.
|
void |
MountTable.checkUnderWritableMountPoint(AlluxioURI alluxioUri)
Checks to see if a write operation is allowed for the specified Alluxio path, by determining
if it is under a readonly mount point.
|
boolean |
MountTable.containsMountPoint(AlluxioURI uri) |
boolean |
MountTable.delete(AlluxioURI uri)
Unmounts the given Alluxio path.
|
List<String> |
LazyUfsBlockLocationCache.get(long blockId,
AlluxioURI fileUri,
long offset) |
List<String> |
UfsBlockLocationCache.get(long blockId,
AlluxioURI fileUri,
long offset)
If the locations exist in the cache, return them, otherwise, retrieves the block locations
from UFS, and caches the result.
|
List<FileBlockInfo> |
FileSystemMasterView.getFileBlockInfoList(AlluxioURI path) |
long |
FileSystemMasterView.getFileId(AlluxioURI path)
Returns the file id for a given path.
|
String |
MountTable.getMountPoint(AlluxioURI uri)
Returns the closest ancestor mount point the given path is nested under.
|
boolean |
InodeTree.inodePathExists(AlluxioURI uri) |
boolean |
NoopUfsAbsentPathCache.isAbsent(AlluxioURI path) |
boolean |
AsyncUfsAbsentPathCache.isAbsent(AlluxioURI path) |
boolean |
UfsAbsentPathCache.isAbsent(AlluxioURI path)
Returns true if the given path is absent, according to this cache.
|
boolean |
MountTable.isMountPoint(AlluxioURI uri) |
LockedInodePath |
InodeTree.lockDescendantPath(LockedInodePath inodePath,
InodeTree.LockMode lockMode,
AlluxioURI descendantUri)
Locks from a specific point in the tree to the descendant, and return a lockedInodePath.
|
LockedInodePath |
InodeTree.lockFullInodePath(AlluxioURI path,
InodeTree.LockMode lockMode)
Locks existing inodes on the specified path, in the specified
InodeTree.LockMode . |
LockedInodePath |
InodeTree.lockInodePath(AlluxioURI path,
InodeTree.LockMode lockMode)
Locks existing inodes on the specified path, in the specified
InodeTree.LockMode . |
InodePathPair |
InodeTree.lockInodePathPair(AlluxioURI path1,
InodeTree.LockMode lockMode1,
AlluxioURI path2,
InodeTree.LockMode lockMode2)
Locks existing inodes on the two specified paths.
|
void |
NoopUfsAbsentPathCache.process(AlluxioURI path,
List<Inode<?>> prefixInodes) |
void |
AsyncUfsAbsentPathCache.process(AlluxioURI path,
List<Inode<?>> prefixInodes) |
void |
UfsAbsentPathCache.process(AlluxioURI path,
List<Inode<?>> prefixInodes)
Processes the given path for the cache.
|
void |
NoopUfsAbsentPathCache.processExisting(AlluxioURI path) |
void |
AsyncUfsAbsentPathCache.processExisting(AlluxioURI path) |
void |
UfsAbsentPathCache.processExisting(AlluxioURI path)
Processes the given path that already exists.
|
MountTable.Resolution |
MountTable.resolve(AlluxioURI uri)
Resolves the given Alluxio path.
|
Constructor and Description |
---|
LockingScheme(AlluxioURI path,
InodeTree.LockMode desiredLockMode,
boolean shouldSync)
Constructs a
LockingScheme . |
MutableLockedInodePath(AlluxioURI uri,
InodeLockList lockList,
InodeTree.LockMode lockMode)
Creates an instance of
MutableLockedInodePath . |
MutableLockedInodePath(AlluxioURI uri,
InodeLockList lockList,
String[] pathComponents,
InodeTree.LockMode lockMode)
Creates an instance of
MutableLockedInodePath . |
MutableLockedInodePath(AlluxioURI descendantUri,
LockedInodePath lockedInodePath,
InodeLockList descendants)
Creates an instance of
MutableLockedInodePath . |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
MountInfo.getAlluxioUri() |
AlluxioURI |
MountInfo.getUfsUri() |
Constructor and Description |
---|
MountInfo(AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountOptions options)
Creates a new instance of
MountInfo . |
Modifier and Type | Method and Description |
---|---|
void |
DefaultKeyValueMaster.completePartition(AlluxioURI path,
PartitionInfo info) |
void |
KeyValueMaster.completePartition(AlluxioURI path,
PartitionInfo info)
Marks a partition complete and adds it to an incomplete key-value store.
|
void |
DefaultKeyValueMaster.completeStore(AlluxioURI path) |
void |
KeyValueMaster.completeStore(AlluxioURI path)
Marks a key-value store complete.
|
void |
DefaultKeyValueMaster.createStore(AlluxioURI path) |
void |
KeyValueMaster.createStore(AlluxioURI path)
Creates a new key-value store.
|
void |
DefaultKeyValueMaster.deleteStore(AlluxioURI uri) |
void |
KeyValueMaster.deleteStore(AlluxioURI uri)
Deletes a completed key-value store.
|
List<PartitionInfo> |
DefaultKeyValueMaster.getPartitionInfo(AlluxioURI path) |
List<PartitionInfo> |
KeyValueMaster.getPartitionInfo(AlluxioURI path)
Gets a list of partitions of a given key-value store.
|
void |
DefaultKeyValueMaster.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri) |
void |
KeyValueMaster.mergeStore(AlluxioURI fromUri,
AlluxioURI toUri)
Merges one completed key-value store to another completed key-value store.
|
void |
DefaultKeyValueMaster.renameStore(AlluxioURI oldUri,
AlluxioURI newUri) |
void |
KeyValueMaster.renameStore(AlluxioURI oldUri,
AlluxioURI newUri)
Renames one completed key-value store.
|
Modifier and Type | Method and Description |
---|---|
long |
LineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Creates a lineage.
|
long |
LineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job)
Creates a lineage.
|
long |
DefaultLineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job) |
long |
DefaultLineageMaster.createLineage(List<AlluxioURI> inputFiles,
List<AlluxioURI> outputFiles,
Job job) |
Modifier and Type | Method and Description |
---|---|
static String |
MetricsSystem.escape(AlluxioURI uri)
Escapes a URI, replacing "/" and "." with "_" so that when the URI is used in a metric name,
the "/" and "." won't be interpreted as path separators.
|
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
BaseUnderFileSystem.mUri
The UFS
AlluxioURI used to create this BaseUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
UfsManager.UfsClient.getUfsMountPointUri() |
AlluxioURI |
UnderFileSystemWithLogging.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
BaseUnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath)
Returns an
AlluxioURI representation for the UnderFileSystem given a base
UFS URI, and the Alluxio path from the base. |
Modifier and Type | Method and Description |
---|---|
void |
MasterUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
void |
UfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Keeps track of a mount id and maps it to its URI in Alluxio and configuration.
|
void |
AbstractUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
AlluxioURI |
UnderFileSystemWithLogging.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
BaseUnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath)
Returns an
AlluxioURI representation for the UnderFileSystem given a base
UFS URI, and the Alluxio path from the base. |
void |
MasterUfsManager.setUfsMode(AlluxioURI ufsPath,
UnderFileSystem.UfsMode ufsMode,
RpcContext rpcContext)
Set the operation mode the given physical ufs.
|
Constructor and Description |
---|
BaseUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
BaseUnderFileSystem . |
ObjectUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
ObjectUnderFileSystem . |
UfsClient(com.google.common.base.Supplier<UnderFileSystem> ufsSupplier,
AlluxioURI ufsMountPointUri) |
Modifier and Type | Method and Description |
---|---|
static COSUnderFileSystem |
COSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
COSUnderFileSystem . |
Constructor and Description |
---|
COSUnderFileSystem(AlluxioURI uri,
com.qcloud.cos.COSClient client,
String bucketName,
String appId,
UnderFileSystemConfiguration conf)
Constructor for
COSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static GCSUnderFileSystem |
GCSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
GCSUnderFileSystem . |
Constructor and Description |
---|
GCSUnderFileSystem(AlluxioURI uri,
org.jets3t.service.impl.rest.httpclient.GoogleStorageService googleStorageService,
String bucketName,
short bucketMode,
String accountOwner,
UnderFileSystemConfiguration conf)
Constructor for
GCSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static HdfsUnderFileSystem |
HdfsUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new HDFS
UnderFileSystem instance. |
Constructor and Description |
---|
HdfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new HDFS
UnderFileSystem . |
Constructor and Description |
---|
LocalUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs a new
LocalUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static OSSUnderFileSystem |
OSSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
OSSUnderFileSystem . |
Constructor and Description |
---|
OSSUnderFileSystem(AlluxioURI uri,
com.aliyun.oss.OSSClient ossClient,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
OSSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static S3AUnderFileSystem |
S3AUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
S3AUnderFileSystem . |
Constructor and Description |
---|
S3AUnderFileSystem(AlluxioURI uri,
com.amazonaws.services.s3.AmazonS3Client amazonS3Client,
String bucketName,
com.amazonaws.services.s3.transfer.TransferManager transferManager,
UnderFileSystemConfiguration conf)
Constructor for
S3AUnderFileSystem . |
Constructor and Description |
---|
SwiftUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new Swift
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static WasbUnderFileSystem |
WasbUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Wasb
UnderFileSystem . |
Constructor and Description |
---|
WasbUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration wasbConf)
Constructs a new Wasb
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static String |
UnderFileSystemUtils.getBucketName(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
static AlluxioURI |
NetworkAddressUtils.replaceHostName(AlluxioURI path)
Replaces and resolves the hostname in a given address or path string.
|
Modifier and Type | Method and Description |
---|---|
static AlluxioURI |
NetworkAddressUtils.replaceHostName(AlluxioURI path)
Replaces and resolves the hostname in a given address or path string.
|
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
BackupResponse.getBackupUri() |
Constructor and Description |
---|
BackupResponse(AlluxioURI backupUri,
String hostname,
long entryCount) |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
UnderFileSystemBlockReader.getUfsMountPointUri() |
Modifier and Type | Method and Description |
---|---|
static void |
UnderFileSystemUtils.prepareFilePath(AlluxioURI alluxioPath,
String ufsPath,
FileSystem fs,
UnderFileSystem ufs)
Creates parent directories for path with correct permissions if required.
|
Copyright © 2023. All Rights Reserved.