Modifier and Type | Field and Description |
---|---|
static AlluxioURI |
AlluxioURI.EMPTY_URI |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
AlluxioURI.getParent()
Get the parent of this
AlluxioURI or null if at root. |
AlluxioURI |
AlluxioURI.join(AlluxioURI suffix)
Append additional path elements to the end of an
AlluxioURI . |
AlluxioURI |
AlluxioURI.join(String suffix)
Append additional path elements to the end of an
AlluxioURI . |
AlluxioURI |
AlluxioURI.joinUnsafe(String suffix)
Append additional path elements to the end of an
AlluxioURI . |
Modifier and Type | Method and Description |
---|---|
Set<AlluxioURI> |
SyncInfo.getChangedFiles(AlluxioURI syncPoint)
REturns a set of changed files.
|
Set<AlluxioURI> |
SyncInfo.getSyncPoints()
Returns a list of sync points.
|
Modifier and Type | Method and Description |
---|---|
int |
AlluxioURI.compareTo(AlluxioURI other) |
Set<AlluxioURI> |
SyncInfo.getChangedFiles(AlluxioURI syncPoint)
REturns a set of changed files.
|
boolean |
AlluxioURI.isAncestorOf(AlluxioURI alluxioURI)
Returns true if the current AlluxioURI is an ancestor of another AlluxioURI.
|
AlluxioURI |
AlluxioURI.join(AlluxioURI suffix)
Append additional path elements to the end of an
AlluxioURI . |
Constructor and Description |
---|
AlluxioURI(AlluxioURI parent,
AlluxioURI child)
Resolves a child
AlluxioURI against a parent AlluxioURI . |
AlluxioURI(AlluxioURI baseURI,
String newPath,
boolean checkNormalization)
Constructs an
AlluxioURI from a base URI and a new path component. |
Constructor and Description |
---|
SyncInfo(Map<AlluxioURI,Set<AlluxioURI>> changedFiles,
boolean forceSync,
long txId)
Constructs a SyncInfo.
|
SyncInfo(Map<AlluxioURI,Set<AlluxioURI>> changedFiles,
boolean forceSync,
long txId)
Constructs a SyncInfo.
|
Modifier and Type | Method and Description |
---|---|
boolean |
FuseShell.isSpecialCommand(AlluxioURI uri)
Checks if the given uri contains Fuse special command.
|
default URIStatus |
FuseCommand.run(AlluxioURI path,
String[] argv)
Runs the command.
|
URIStatus |
FuseShell.runCommand(AlluxioURI uri) |
Constructor and Description |
---|
BasicNonByteBufferOperations(AlluxioURI filePath,
ReadType readType,
WriteType writeType,
boolean deleteIfExists,
int length,
FileSystemContext fsContext) |
BasicOperations(AlluxioURI filePath,
ReadType readType,
WriteType writeType,
FileSystemContext fsContext) |
Modifier and Type | Method and Description |
---|---|
URIStatus |
AbstractMetadataCacheSubCommand.run(AlluxioURI path,
String[] argv) |
protected URIStatus |
DropCommand.runSubCommand(AlluxioURI path,
String[] argv,
MetadataCachingFileSystem fileSystem) |
protected URIStatus |
SizeCommand.runSubCommand(AlluxioURI path,
String[] argv,
MetadataCachingFileSystem fileSystem) |
protected abstract URIStatus |
AbstractMetadataCacheSubCommand.runSubCommand(AlluxioURI path,
String[] argv,
MetadataCachingFileSystem fs)
Run the metadatacache subcommand.
|
protected URIStatus |
DropAllCommand.runSubCommand(AlluxioURI path,
String[] argv,
MetadataCachingFileSystem fileSystem) |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemShellUtils.getAlluxioURIs(FileSystem alluxioClient,
AlluxioURI inputURI)
Gets all the
AlluxioURI s that match inputURI. |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemShellUtils.getAlluxioURIs(FileSystem alluxioClient,
AlluxioURI inputURI)
Gets all the
AlluxioURI s that match inputURI. |
Modifier and Type | Method and Description |
---|---|
static long |
DistributedLoadUtils.runDistLoad(AbstractDistributedJobCommand command,
AlluxioURI filePath,
int replication,
int batchSize,
Set<String> workerSet,
Set<String> excludedWorkerSet,
Set<String> localityIds,
Set<String> excludedLocalityIds,
boolean directCache)
Run the actual distributedLoad command.
|
protected void |
UnsetTtlCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
StartSyncCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
DuCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
SetFaclCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LoadMetadataCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChownCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
GetFaclCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LsCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
NeedsSyncCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
UnmountCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
FreeCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
UnpinCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LocationCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
StopSyncCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
HeadCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChecksumCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
RmCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
CheckConsistencyCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
CatCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChgrpCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
TailCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
LoadCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
SyncDirNextTimeCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
ChmodCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
TouchCommand.runPlainPath(AlluxioURI inputPath,
org.apache.commons.cli.CommandLine cl) |
protected void |
SetTtlCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
PinCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
AbstractFileSystemCommand.runPlainPath(AlluxioURI plainPath,
org.apache.commons.cli.CommandLine cl)
Runs the command for a particular URI that does not contain wildcard in its path.
|
protected void |
StatCommand.runPlainPath(AlluxioURI path,
org.apache.commons.cli.CommandLine cl) |
protected void |
AbstractFileSystemCommand.runWildCardCmd(AlluxioURI wildCardPath,
org.apache.commons.cli.CommandLine cl)
Runs the command for a particular URI that may contain wildcard in its path.
|
static void |
FileSystemCommandUtils.setDirectChildrenLoaded(FileSystem fs,
AlluxioURI path,
boolean directChildrenLoaded)
Sets direct children loaded.
|
static void |
FileSystemCommandUtils.setPinned(FileSystem fs,
AlluxioURI path,
boolean pinned,
List<String> mediumTypes)
Sets pin state for the input path.
|
static void |
FileSystemCommandUtils.setTtl(FileSystem fs,
AlluxioURI path,
long ttlMs,
TtlAction ttlAction)
Sets a new TTL value or unsets an existing TTL value for file at path.
|
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
AlluxioFileOutStream.mUri |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
RetryHandlingFileSystemMasterClient.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemCache.InstanceCachingFileSystem.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
BaseFileSystem.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemMasterClient.reverseResolve(AlluxioURI ufsUri)
Reverse resolve a ufs uri.
|
AlluxioURI |
FileSystem.reverseResolve(AlluxioURI ufsUri)
Reverse resolve a ufs uri.
|
AlluxioURI |
DelegatingFileSystem.reverseResolve(AlluxioURI ufsUri) |
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
RetryHandlingFileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyPOptions options) |
List<AlluxioURI> |
FileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyPOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
Modifier and Type | Method and Description |
---|---|
void |
MetadataCachingFileSystem.asyncUpdateFileAccessTime(AlluxioURI path)
Asynchronously update file's last access time.
|
void |
RetryHandlingFileSystemMasterClient.checkAccess(AlluxioURI path,
CheckAccessPOptions options) |
void |
BaseFileSystem.checkAccess(AlluxioURI path,
CheckAccessPOptions options) |
void |
FileSystemMasterClient.checkAccess(AlluxioURI path,
CheckAccessPOptions options)
Check access to a path.
|
void |
FileSystem.checkAccess(AlluxioURI path,
CheckAccessPOptions options)
Checks access to a path.
|
void |
DelegatingFileSystem.checkAccess(AlluxioURI path,
CheckAccessPOptions options) |
List<AlluxioURI> |
RetryHandlingFileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyPOptions options) |
List<AlluxioURI> |
FileSystemMasterClient.checkConsistency(AlluxioURI path,
CheckConsistencyPOptions options)
Checks the consistency of Alluxio metadata against the under storage for all files and
directories in a given subtree.
|
protected void |
BaseFileSystem.checkUri(AlluxioURI uri)
Checks an
AlluxioURI for scheme and authority information. |
void |
RetryHandlingFileSystemMasterClient.completeFile(AlluxioURI path,
CompleteFilePOptions options) |
void |
FileSystemMasterClient.completeFile(AlluxioURI path,
CompleteFilePOptions options)
Marks a file as completed.
|
default void |
FileSystem.createDirectory(AlluxioURI path)
Convenience method for
FileSystem.createDirectory(AlluxioURI, CreateDirectoryPOptions) with
default options. |
void |
RetryHandlingFileSystemMasterClient.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
void |
BaseFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
void |
FileSystemMasterClient.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options)
Creates a new directory.
|
void |
FileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options)
Creates a directory.
|
void |
DelegatingFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
void |
MetadataCachingFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
default FileOutStream |
FileSystem.createFile(AlluxioURI path)
Convenience method for
FileSystem.createFile(AlluxioURI, CreateFilePOptions) with default
options. |
URIStatus |
RetryHandlingFileSystemMasterClient.createFile(AlluxioURI path,
CreateFilePOptions options) |
FileOutStream |
FileSystemCache.InstanceCachingFileSystem.createFile(AlluxioURI path,
CreateFilePOptions options) |
FileOutStream |
BaseFileSystem.createFile(AlluxioURI path,
CreateFilePOptions options) |
URIStatus |
FileSystemMasterClient.createFile(AlluxioURI path,
CreateFilePOptions options)
Creates a new file.
|
FileOutStream |
FileSystem.createFile(AlluxioURI path,
CreateFilePOptions options)
Creates a file.
|
FileOutStream |
DelegatingFileSystem.createFile(AlluxioURI path,
CreateFilePOptions options) |
FileOutStream |
MetadataCachingFileSystem.createFile(AlluxioURI path,
CreateFilePOptions options) |
default void |
FileSystem.delete(AlluxioURI path)
Convenience method for
FileSystem.delete(AlluxioURI, DeletePOptions) with default options. |
void |
RetryHandlingFileSystemMasterClient.delete(AlluxioURI path,
DeletePOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.delete(AlluxioURI path,
DeletePOptions options) |
void |
BaseFileSystem.delete(AlluxioURI path,
DeletePOptions options) |
void |
FileSystemMasterClient.delete(AlluxioURI path,
DeletePOptions options)
Deletes a file or a directory.
|
void |
FileSystem.delete(AlluxioURI path,
DeletePOptions options)
Deletes a file or a directory.
|
void |
DelegatingFileSystem.delete(AlluxioURI path,
DeletePOptions options) |
void |
MetadataCachingFileSystem.delete(AlluxioURI path,
DeletePOptions options) |
void |
MetadataCachingFileSystem.dropMetadataCache(AlluxioURI uri)
Best efforts to drops metadata cache of a given uri,
all its ancestors and descendants.
|
default boolean |
FileSystem.exists(AlluxioURI path)
Convenience method for
FileSystem.exists(AlluxioURI, ExistsPOptions) with default options. |
boolean |
RetryHandlingFileSystemMasterClient.exists(AlluxioURI path,
ExistsPOptions options) |
boolean |
FileSystemCache.InstanceCachingFileSystem.exists(AlluxioURI path,
ExistsPOptions options) |
boolean |
BaseFileSystem.exists(AlluxioURI path,
ExistsPOptions options) |
boolean |
FileSystemMasterClient.exists(AlluxioURI path,
ExistsPOptions options)
Checks whether a file or directory exists.
|
boolean |
FileSystem.exists(AlluxioURI path,
ExistsPOptions options)
Checks whether a path exists in Alluxio space.
|
boolean |
DelegatingFileSystem.exists(AlluxioURI path,
ExistsPOptions options) |
default void |
FileSystem.free(AlluxioURI path)
Convenience method for
FileSystem.free(AlluxioURI, FreePOptions) with default options. |
void |
RetryHandlingFileSystemMasterClient.free(AlluxioURI path,
FreePOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.free(AlluxioURI path,
FreePOptions options) |
void |
BaseFileSystem.free(AlluxioURI path,
FreePOptions options) |
void |
FileSystemMasterClient.free(AlluxioURI path,
FreePOptions options)
Frees a file.
|
void |
FileSystem.free(AlluxioURI path,
FreePOptions options)
Evicts any data under the given path from Alluxio space, but does not delete the data from the
UFS.
|
void |
DelegatingFileSystem.free(AlluxioURI path,
FreePOptions options) |
URIStatus |
MetadataCache.get(AlluxioURI path) |
List<BlockLocationInfo> |
FileSystemCache.InstanceCachingFileSystem.getBlockLocations(AlluxioURI path) |
default List<BlockLocationInfo> |
FileSystem.getBlockLocations(AlluxioURI path)
Builds a list of
BlockLocationInfo for the given file. |
List<BlockLocationInfo> |
DelegatingFileSystem.getBlockLocations(AlluxioURI path) |
List<BlockLocationInfo> |
MetadataCachingFileSystem.getBlockLocations(AlluxioURI path) |
String |
RetryHandlingFileSystemMasterClient.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose) |
String |
BaseFileSystem.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose) |
String |
FileSystemMasterClient.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose)
Get progress of a load job.
|
String |
FileSystem.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose)
Get progress of a load job.
|
String |
DelegatingFileSystem.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose) |
long |
RetryHandlingFileSystemMasterClient.getNewBlockIdForFile(AlluxioURI path) |
long |
FileSystemMasterClient.getNewBlockIdForFile(AlluxioURI path) |
AlluxioConfiguration |
FileSystemContext.getPathConf(AlluxioURI path)
The path level configuration is a
SpecificPathConfiguration . |
default URIStatus |
FileSystem.getStatus(AlluxioURI path)
Convenience method for
FileSystem.getStatus(AlluxioURI, GetStatusPOptions) with default options. |
URIStatus |
RetryHandlingFileSystemMasterClient.getStatus(AlluxioURI path,
GetStatusPOptions options) |
URIStatus |
FileSystemCache.InstanceCachingFileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options) |
URIStatus |
BaseFileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options) |
URIStatus |
FileSystemMasterClient.getStatus(AlluxioURI path,
GetStatusPOptions options) |
URIStatus |
FileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options)
Gets the
URIStatus object that represents the metadata of an Alluxio path. |
URIStatus |
DelegatingFileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options) |
URIStatus |
MetadataCachingFileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options) |
void |
MetadataCache.invalidate(AlluxioURI path)
Invalidates the cache of path.
|
default void |
FileSystem.iterateStatus(AlluxioURI path,
java.util.function.Consumer<? super URIStatus> action)
Performs a specific action on each
URIStatus in the result of FileSystem.listStatus(alluxio.AlluxioURI) . |
void |
RetryHandlingFileSystemMasterClient.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
void |
FileSystemCache.InstanceCachingFileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
void |
BaseFileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
void |
FileSystemMasterClient.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action)
Performs a specific action on each
URIStatus in the result of FileSystemMasterClient.listStatus(alluxio.AlluxioURI, alluxio.grpc.ListStatusPOptions) . |
void |
FileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action)
Performs a specific action on each
URIStatus in the result of FileSystem.listStatus(alluxio.AlluxioURI) . |
void |
DelegatingFileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
void |
MetadataCachingFileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
List<URIStatus> |
MetadataCache.listStatus(AlluxioURI dir) |
default List<URIStatus> |
FileSystem.listStatus(AlluxioURI path)
Convenience method for
FileSystem.listStatus(AlluxioURI, ListStatusPOptions) with default
options. |
List<URIStatus> |
RetryHandlingFileSystemMasterClient.listStatus(AlluxioURI path,
ListStatusPOptions options) |
List<URIStatus> |
FileSystemCache.InstanceCachingFileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options) |
List<URIStatus> |
BaseFileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options) |
List<URIStatus> |
FileSystemMasterClient.listStatus(AlluxioURI path,
ListStatusPOptions options) |
List<URIStatus> |
FileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options)
If the path is a directory, returns the
URIStatus of all the direct entries in it. |
List<URIStatus> |
DelegatingFileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options) |
List<URIStatus> |
MetadataCachingFileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options) |
ListStatusPartialResult |
RetryHandlingFileSystemMasterClient.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options) |
ListStatusPartialResult |
BaseFileSystem.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options) |
ListStatusPartialResult |
FileSystemMasterClient.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options) |
ListStatusPartialResult |
FileSystem.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options)
Same as
FileSystem.listStatus(AlluxioURI, ListStatusPOptions) except may
only return a subset of the results as determined by the options parameter. |
ListStatusPartialResult |
DelegatingFileSystem.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options) |
default void |
FileSystem.loadMetadata(AlluxioURI path)
Convenience method for
FileSystem.loadMetadata(AlluxioURI, ListStatusPOptions) with default
options. |
void |
BaseFileSystem.loadMetadata(AlluxioURI path,
ListStatusPOptions options) |
void |
FileSystem.loadMetadata(AlluxioURI path,
ListStatusPOptions options)
Loads metadata about a path in the UFS to Alluxio.
|
void |
DelegatingFileSystem.loadMetadata(AlluxioURI path,
ListStatusPOptions options) |
default void |
FileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath)
Convenience method for
FileSystem.mount(AlluxioURI, AlluxioURI, MountPOptions) with default
options. |
void |
RetryHandlingFileSystemMasterClient.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options) |
void |
BaseFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options) |
void |
FileSystemMasterClient.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options)
Mounts the given UFS path under the given Alluxio path.
|
void |
FileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options)
Mounts a UFS subtree to the given Alluxio path.
|
void |
DelegatingFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options) |
void |
RetryHandlingFileSystemMasterClient.needsSync(AlluxioURI path) |
void |
BaseFileSystem.needsSync(AlluxioURI path) |
void |
FileSystemMasterClient.needsSync(AlluxioURI path)
Mark a path as needed synchronization with the UFS, when this path or any
of its children are accessed, a sync with the UFS will be performed.
|
void |
FileSystem.needsSync(AlluxioURI path)
Marks the path in Alluxio as needing sync with the UFS.
|
void |
DelegatingFileSystem.needsSync(AlluxioURI path) |
default FileInStream |
FileSystem.openFile(AlluxioURI path)
Convenience method for
FileSystem.openFile(AlluxioURI, OpenFilePOptions) with default options. |
FileInStream |
FileSystemCache.InstanceCachingFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
FileInStream |
BaseFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
FileInStream |
FileSystem.openFile(AlluxioURI path,
OpenFilePOptions options)
Opens a file for reading.
|
FileInStream |
DelegatingFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
FileInStream |
MetadataCachingFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
default void |
FileSystem.persist(AlluxioURI path)
Convenience method for
FileSystem.persist(AlluxioURI, ScheduleAsyncPersistencePOptions) which
uses the default ScheduleAsyncPersistencePOptions . |
void |
FileSystemCache.InstanceCachingFileSystem.persist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options) |
void |
BaseFileSystem.persist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options) |
void |
FileSystem.persist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options)
Schedules the given path to be asynchronously persisted to the under file system.
|
void |
DelegatingFileSystem.persist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options) |
static void |
FileSystemUtils.persistAndWait(FileSystem fs,
AlluxioURI uri,
long persistenceWaitTime)
Convenience method for
#persistAndWait(fs, uri, persistenceWaitTime, -1) . |
static void |
FileSystemUtils.persistAndWait(FileSystem fs,
AlluxioURI uri,
long persistenceWaitTime,
int timeoutMs)
Persists the given path to the under file system and returns once the persist is complete.
|
void |
MetadataCache.put(AlluxioURI dir,
List<URIStatus> statuses)
Caches list status results of a directory.
|
void |
MetadataCache.put(AlluxioURI path,
URIStatus status) |
void |
RetryHandlingFileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst) |
void |
FileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst)
Renames a file or a directory.
|
default void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst)
Convenience method for
FileSystem.rename(AlluxioURI, AlluxioURI, RenamePOptions) with default
options. |
void |
RetryHandlingFileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
void |
BaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
void |
FileSystemMasterClient.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options)
Renames a file or a directory.
|
void |
FileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options)
Renames an existing Alluxio path to another Alluxio path in Alluxio.
|
void |
DelegatingFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
void |
MetadataCachingFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
AlluxioURI |
RetryHandlingFileSystemMasterClient.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemCache.InstanceCachingFileSystem.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
BaseFileSystem.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemMasterClient.reverseResolve(AlluxioURI ufsUri)
Reverse resolve a ufs uri.
|
AlluxioURI |
FileSystem.reverseResolve(AlluxioURI ufsUri)
Reverse resolve a ufs uri.
|
AlluxioURI |
DelegatingFileSystem.reverseResolve(AlluxioURI ufsUri) |
void |
RetryHandlingFileSystemMasterClient.scheduleAsyncPersist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options) |
void |
FileSystemMasterClient.scheduleAsyncPersist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options)
Schedules the async persistence of the given file.
|
default void |
FileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries)
Convenience method for
FileSystem.setAcl(AlluxioURI, SetAclAction, List, SetAclPOptions) with
default options. |
void |
RetryHandlingFileSystemMasterClient.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options) |
void |
BaseFileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options) |
void |
FileSystemMasterClient.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options)
Sets the ACL for a path.
|
void |
FileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options)
Sets the ACL for a path.
|
void |
DelegatingFileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options) |
default void |
FileSystem.setAttribute(AlluxioURI path)
Convenience method for
FileSystem.setAttribute(AlluxioURI, SetAttributePOptions) with default
options. |
void |
RetryHandlingFileSystemMasterClient.setAttribute(AlluxioURI path,
SetAttributePOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.setAttribute(AlluxioURI path,
SetAttributePOptions options) |
void |
BaseFileSystem.setAttribute(AlluxioURI path,
SetAttributePOptions options) |
void |
FileSystemMasterClient.setAttribute(AlluxioURI path,
SetAttributePOptions options)
Sets the file or directory attributes.
|
void |
FileSystem.setAttribute(AlluxioURI path,
SetAttributePOptions options)
Sets any number of a path's attributes, such as TTL and pin status.
|
void |
DelegatingFileSystem.setAttribute(AlluxioURI path,
SetAttributePOptions options) |
void |
RetryHandlingFileSystemMasterClient.startSync(AlluxioURI path) |
void |
FileSystemCache.InstanceCachingFileSystem.startSync(AlluxioURI path) |
void |
BaseFileSystem.startSync(AlluxioURI path)
Starts the active syncing process on an Alluxio path.
|
void |
FileSystemMasterClient.startSync(AlluxioURI path)
Start the active syncing process for a specified path.
|
void |
FileSystem.startSync(AlluxioURI path)
Starts the active syncing process on an Alluxio path.
|
void |
DelegatingFileSystem.startSync(AlluxioURI path) |
boolean |
RetryHandlingFileSystemMasterClient.stopLoad(AlluxioURI path) |
boolean |
BaseFileSystem.stopLoad(AlluxioURI path) |
boolean |
FileSystemMasterClient.stopLoad(AlluxioURI path)
Stop a directory load.
|
boolean |
FileSystem.stopLoad(AlluxioURI path)
Stop a load job.
|
boolean |
DelegatingFileSystem.stopLoad(AlluxioURI path) |
void |
RetryHandlingFileSystemMasterClient.stopSync(AlluxioURI path) |
void |
FileSystemCache.InstanceCachingFileSystem.stopSync(AlluxioURI path) |
void |
BaseFileSystem.stopSync(AlluxioURI path)
Stops the active syncing process on an Alluxio path.
|
void |
FileSystemMasterClient.stopSync(AlluxioURI path)
Stop the active syncing process for a specified path.
|
void |
FileSystem.stopSync(AlluxioURI path)
Stops the active syncing process on an Alluxio path.
|
void |
DelegatingFileSystem.stopSync(AlluxioURI path) |
boolean |
RetryHandlingFileSystemMasterClient.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify) |
boolean |
BaseFileSystem.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify) |
boolean |
FileSystemMasterClient.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify)
Submit a directory load job.
|
boolean |
FileSystem.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify)
Submit a load job.
|
boolean |
DelegatingFileSystem.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify) |
void |
RetryHandlingFileSystemMasterClient.unmount(AlluxioURI alluxioPath) |
void |
FileSystemMasterClient.unmount(AlluxioURI alluxioPath)
Unmounts the given Alluxio path.
|
default void |
FileSystem.unmount(AlluxioURI path)
Convenience method for
FileSystem.unmount(AlluxioURI, UnmountPOptions) with default options. |
void |
FileSystemCache.InstanceCachingFileSystem.unmount(AlluxioURI path,
UnmountPOptions options) |
void |
BaseFileSystem.unmount(AlluxioURI path,
UnmountPOptions options) |
void |
FileSystem.unmount(AlluxioURI path,
UnmountPOptions options)
Unmounts a UFS subtree identified by the given Alluxio path.
|
void |
DelegatingFileSystem.unmount(AlluxioURI path,
UnmountPOptions options) |
void |
RetryHandlingFileSystemMasterClient.updateMount(AlluxioURI alluxioPath,
MountPOptions options) |
void |
FileSystemCache.InstanceCachingFileSystem.updateMount(AlluxioURI alluxioPath,
MountPOptions options) |
void |
BaseFileSystem.updateMount(AlluxioURI alluxioPath,
MountPOptions options) |
void |
FileSystemMasterClient.updateMount(AlluxioURI alluxioPath,
MountPOptions options)
Updates options of a mount point for the given Alluxio path.
|
void |
FileSystem.updateMount(AlluxioURI alluxioPath,
MountPOptions options)
Updates the options for an existing mount point.
|
void |
DelegatingFileSystem.updateMount(AlluxioURI alluxioPath,
MountPOptions options) |
void |
RetryHandlingFileSystemMasterClient.updateUfsMode(AlluxioURI ufsUri,
UpdateUfsModePOptions options) |
void |
FileSystemMasterClient.updateUfsMode(AlluxioURI ufsUri,
UpdateUfsModePOptions options)
Updates the operation mode for the given ufs path.
|
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri)
Shortcut for
waitCompleted(fs, uri, -1, TimeUnit.MILLISECONDS) , i.e., wait for an
indefinite amount of time. |
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri,
long timeout,
TimeUnit tunit)
Waits for a file to be marked as completed.
|
static void |
FileSystemUtils.waitForAlluxioPercentage(FileSystem fs,
AlluxioURI uri,
int expectedPercentage)
Waits until the specified file has the desired percentage in Alluxio.
|
Constructor and Description |
---|
AlluxioFileOutStream(AlluxioURI path,
OutStreamOptions options,
FileSystemContext context)
Creates a new file output stream.
|
Modifier and Type | Method and Description |
---|---|
FileInStream |
LocalCacheFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
UfsBaseFileSystem.mRootUFS |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
UfsBaseFileSystem.reverseResolve(AlluxioURI ufsUri) |
Modifier and Type | Method and Description |
---|---|
void |
UfsBaseFileSystem.checkAccess(AlluxioURI path,
CheckAccessPOptions options) |
void |
UfsBaseFileSystem.createDirectory(AlluxioURI path,
CreateDirectoryPOptions options) |
FileOutStream |
UfsBaseFileSystem.createFile(AlluxioURI path,
CreateFilePOptions options) |
void |
UfsBaseFileSystem.delete(AlluxioURI path,
DeletePOptions options) |
boolean |
UfsBaseFileSystem.exists(AlluxioURI path,
ExistsPOptions options) |
void |
UfsBaseFileSystem.free(AlluxioURI path,
FreePOptions options) |
List<BlockLocationInfo> |
UfsBaseFileSystem.getBlockLocations(AlluxioURI path) |
String |
UfsBaseFileSystem.getLoadProgress(AlluxioURI path,
Optional<LoadProgressReportFormat> format,
boolean verbose) |
URIStatus |
UfsBaseFileSystem.getStatus(AlluxioURI path) |
URIStatus |
UfsBaseFileSystem.getStatus(AlluxioURI path,
GetStatusPOptions options) |
void |
UfsBaseFileSystem.iterateStatus(AlluxioURI path,
ListStatusPOptions options,
java.util.function.Consumer<? super URIStatus> action) |
List<URIStatus> |
UfsBaseFileSystem.listStatus(AlluxioURI path,
ListStatusPOptions options) |
ListStatusPartialResult |
UfsBaseFileSystem.listStatusPartial(AlluxioURI path,
ListStatusPartialPOptions options) |
void |
UfsBaseFileSystem.loadMetadata(AlluxioURI path,
ListStatusPOptions options) |
void |
UfsBaseFileSystem.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountPOptions options) |
void |
UfsBaseFileSystem.needsSync(AlluxioURI path) |
FileInStream |
UfsBaseFileSystem.openFile(AlluxioURI path,
OpenFilePOptions options) |
void |
UfsBaseFileSystem.persist(AlluxioURI path,
ScheduleAsyncPersistencePOptions options) |
void |
UfsBaseFileSystem.rename(AlluxioURI src,
AlluxioURI dst,
RenamePOptions options) |
AlluxioURI |
UfsBaseFileSystem.reverseResolve(AlluxioURI ufsUri) |
void |
UfsBaseFileSystem.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclPOptions options) |
void |
UfsBaseFileSystem.setAttribute(AlluxioURI path,
SetAttributePOptions options) |
void |
UfsBaseFileSystem.startSync(AlluxioURI path)
Starts the active syncing process on an Alluxio path.
|
boolean |
UfsBaseFileSystem.stopLoad(AlluxioURI path) |
void |
UfsBaseFileSystem.stopSync(AlluxioURI path)
Stops the active syncing process on an Alluxio path.
|
boolean |
UfsBaseFileSystem.submitLoad(AlluxioURI path,
OptionalLong bandwidth,
boolean usePartialListing,
boolean verify) |
void |
UfsBaseFileSystem.unmount(AlluxioURI path,
UnmountPOptions options) |
void |
UfsBaseFileSystem.updateMount(AlluxioURI alluxioPath,
MountPOptions options) |
Modifier and Type | Method and Description |
---|---|
void |
MetaMasterConfigClient.removePathConfiguration(AlluxioURI path)
Removes all properties for a path.
|
void |
RetryHandlingMetaMasterConfigClient.removePathConfiguration(AlluxioURI path) |
void |
MetaMasterConfigClient.removePathConfiguration(AlluxioURI path,
Set<PropertyKey> keys)
Removes properties for a path.
|
void |
RetryHandlingMetaMasterConfigClient.removePathConfiguration(AlluxioURI path,
Set<PropertyKey> keys) |
void |
MetaMasterConfigClient.setPathConfiguration(AlluxioURI path,
Map<PropertyKey,String> properties)
Sets properties for a path.
|
void |
RetryHandlingMetaMasterConfigClient.setPathConfiguration(AlluxioURI path,
Map<PropertyKey,String> properties) |
default void |
MetaMasterConfigClient.setPathConfiguration(AlluxioURI path,
PropertyKey key,
String value)
Sets a property for a path.
|
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
ManagedBlockingUfsForwarder.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
ManagedBlockingUfsForwarder.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
void |
ManagedBlockingUfsForwarder.startSync(AlluxioURI uri) |
void |
ManagedBlockingUfsForwarder.stopSync(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
Optional<AlluxioConfiguration> |
PrefixPathConfiguration.getConfiguration(AlluxioURI path,
PropertyKey key) |
Optional<AlluxioConfiguration> |
PathConfiguration.getConfiguration(AlluxioURI path,
PropertyKey key) |
Set<PropertyKey> |
PrefixPathConfiguration.getPropertyKeys(AlluxioURI path) |
Set<PropertyKey> |
PathConfiguration.getPropertyKeys(AlluxioURI path) |
Optional<List<String>> |
PrefixPathMatcher.match(AlluxioURI path) |
Optional<List<String>> |
PathMatcher.match(AlluxioURI path) |
Constructor and Description |
---|
SpecificPathConfiguration(AlluxioConfiguration clusterConf,
PathConfiguration pathConf,
AlluxioURI path)
Constructs a new instance with the specified references without copying the underlying
properties.
|
Constructor and Description |
---|
FileDoesNotExistException(AlluxioURI path)
Constructs a new exception stating that the given path does not exist.
|
FileIncompleteException(AlluxioURI path)
Constructs a new exception stating that the given file is incomplete.
|
OpenDirectoryException(AlluxioURI path)
Constructs a new exception stating that the given directory cannot be opened for reading.
|
Modifier and Type | Field and Description |
---|---|
AlluxioURI |
FileSystemBench.ThreadState.mURI |
Modifier and Type | Method and Description |
---|---|
static com.google.common.cache.LoadingCache<String,AlluxioURI> |
AlluxioFuseUtils.getPathResolverCache(AlluxioConfiguration conf,
FuseOptions options)
Gets the cache for resolving FUSE path into
AlluxioURI . |
Modifier and Type | Method and Description |
---|---|
static int |
AlluxioFuseUtils.checkNameLength(AlluxioURI uri)
Checks the input file length.
|
static FileOutStream |
AlluxioFuseUtils.createFile(FileSystem fileSystem,
AuthPolicy authPolicy,
AlluxioURI uri,
CreateFileStatus fileStatus)
Creates a file in alluxio namespace.
|
static void |
AlluxioFuseUtils.deletePath(FileSystem fileSystem,
AlluxioURI uri)
Deletes a file or a directory in alluxio namespace.
|
static Optional<URIStatus> |
AlluxioFuseUtils.getPathStatus(FileSystem fileSystem,
AlluxioURI uri)
Gets the path status.
|
static void |
AlluxioFuseUtils.setAttribute(FileSystem fileSystem,
AlluxioURI uri,
SetAttributePOptions options)
Sets attribute for a file.
|
static Optional<URIStatus> |
AlluxioFuseUtils.waitForFileCompleted(FileSystem fileSystem,
AlluxioURI uri)
Waits for the file to complete.
|
Modifier and Type | Method and Description |
---|---|
void |
CustomAuthPolicy.setUserGroup(AlluxioURI uri,
long uid,
long gid) |
void |
AuthPolicy.setUserGroup(AlluxioURI uri,
long uid,
long gid)
Sets user and group based on user group input.
|
void |
LaunchUserGroupAuthPolicy.setUserGroup(AlluxioURI uri,
long uid,
long gid) |
void |
CustomAuthPolicy.setUserGroupIfNeeded(AlluxioURI uri) |
void |
AuthPolicy.setUserGroupIfNeeded(AlluxioURI uri)
Sets user and group based on authentication policy.
|
void |
LaunchUserGroupAuthPolicy.setUserGroupIfNeeded(AlluxioURI uri) |
void |
SystemUserGroupAuthPolicy.setUserGroupIfNeeded(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
FuseFileStream |
FuseFileStream.Factory.create(AlluxioURI uri,
int flags,
long mode)
Factory method for creating/opening a file
and creating an implementation of
FuseFileStream . |
static FuseFileInOrOutStream |
FuseFileInOrOutStream.create(FileSystem fileSystem,
AuthPolicy authPolicy,
FuseReadWriteLockManager lockManager,
AlluxioURI uri,
int flags,
long mode)
Creates a
FuseFileInOrOutStream . |
static FuseFileOutStream |
FuseFileOutStream.create(FileSystem fileSystem,
AuthPolicy authPolicy,
FuseReadWriteLockManager lockManager,
AlluxioURI uri,
int flags,
long mode)
Creates a
FuseFileInOrOutStream . |
static FuseFileInStream |
FuseFileInStream.create(FileSystem fileSystem,
FuseReadWriteLockManager lockManager,
AlluxioURI uri)
Creates a
FuseFileInStream . |
Modifier and Type | Method and Description |
---|---|
protected AlluxioURI |
FileSystem.getAlluxioPath(org.apache.hadoop.fs.Path path) |
protected abstract AlluxioURI |
AbstractFileSystem.getAlluxioPath(org.apache.hadoop.fs.Path path)
Used to convert hadoop path to Alluxio path.
|
Modifier and Type | Method and Description |
---|---|
static org.apache.hadoop.fs.Path |
HadoopUtils.toPath(AlluxioURI alluxioURI) |
Constructor and Description |
---|
BaseHdfsFileInputStream(FileSystem fs,
AlluxioURI uri,
org.apache.hadoop.fs.FileSystem.Statistics stats)
Constructs a new stream for reading a file from HDFS.
|
HdfsFileInputStream(FileSystem fs,
AlluxioURI uri,
org.apache.hadoop.fs.FileSystem.Statistics stats)
Constructs a new stream for reading a file from HDFS.
|
Modifier and Type | Method and Description |
---|---|
long |
DefaultReplicationHandler.migrate(AlluxioURI uri,
long blockId,
String workerHost,
String mediumType) |
long |
ReplicationHandler.migrate(AlluxioURI uri,
long blockId,
String workerHost,
String mediumType)
Migrate blocks to the correctly pinned locations.
|
long |
DefaultReplicationHandler.setReplica(AlluxioURI uri,
long blockId,
int numReplicas) |
long |
ReplicationHandler.setReplica(AlluxioURI uri,
long blockId,
int numReplicas)
Set the block replication level by a target number of replicas.
|
Modifier and Type | Method and Description |
---|---|
static void |
ReadWriterUtils.checkUri(AlluxioURI uri)
Checks preconditions of uri.
|
static TableReader |
TableReader.create(AlluxioURI uri,
PartitionInfo pInfo) |
static TableWriter |
TableWriter.create(TableSchema schema,
AlluxioURI uri) |
static TableWriter |
TableWriter.create(TableSchema schema,
AlluxioURI uri,
PartitionInfo partitionInfo) |
Modifier and Type | Method and Description |
---|---|
static CsvReader |
CsvReader.create(AlluxioURI uri,
PartitionInfo pInfo)
Creates a CSV reader.
|
Modifier and Type | Method and Description |
---|---|
static OrcReader |
OrcReader.create(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
static ParquetReader |
ParquetReader.create(AlluxioURI uri)
Creates a parquet reader.
|
static ParquetWriter |
ParquetWriter.create(TableSchema schema,
AlluxioURI uri)
Creates a Parquet writer.
|
static ParquetWriter |
ParquetWriter.create(TableSchema schema,
AlluxioURI uri,
int rowGroupSize,
boolean enableDictionary)
Creates a Parquet writer specifying a row group size and whether to have dictionary enabled.
|
static ParquetWriter |
ParquetWriter.create(TableSchema schema,
AlluxioURI uri,
int rowGroupSize,
boolean enableDictionary,
String compressionCodec)
Creates a Parquet writer specifying a row group size.
|
static ParquetWriter |
ParquetWriter.create(TableSchema schema,
AlluxioURI uri,
PartitionInfo partitionInfo)
Creates a parquet writer based on the partitionInfo.
|
Modifier and Type | Method and Description |
---|---|
static TablesWriter |
TablesWriter.create(TableSchema schema,
Committer committer,
AlluxioURI outputDir) |
Modifier and Type | Method and Description |
---|---|
static void |
Utils.createFile(FileSystem fs,
AlluxioURI path)
Creates a file at the given path.
|
static void |
Utils.createFile(FileSystem fs,
AlluxioURI path,
CreateFilePOptions options)
Creates a file at the given path.
|
Modifier and Type | Method and Description |
---|---|
protected AlluxioURI |
AbstractBackupRole.takeBackup(BackupPRequest request,
AtomicLong entryCounter)
Takes a backup on local master.
|
Modifier and Type | Method and Description |
---|---|
void |
BackupTracker.updateBackupUri(AlluxioURI backupUri)
Updates backup URI of status.
|
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
DefaultFileSystemMaster.getPath(long fileId) |
AlluxioURI |
FileSystemMaster.getPath(long fileId)
Gets the path of a file with the given id.
|
AlluxioURI |
PersistJob.getUri() |
AlluxioURI |
DefaultFileSystemMaster.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemMaster.reverseResolve(AlluxioURI ufsUri)
Reverse path resolve a ufs uri to an Alluxio path.
|
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
DefaultFileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyContext context) |
List<AlluxioURI> |
FileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyContext context)
Checks the consistency of the files and directories in the subtree under the path.
|
List<AlluxioURI> |
DefaultFileSystemMaster.getInAlluxioFiles() |
List<AlluxioURI> |
FileSystemMaster.getInAlluxioFiles() |
List<AlluxioURI> |
DefaultFileSystemMaster.getInMemoryFiles() |
List<AlluxioURI> |
FileSystemMaster.getInMemoryFiles() |
Modifier and Type | Method and Description |
---|---|
void |
DefaultFileSystemMaster.activeSyncMetadata(AlluxioURI path,
Collection<AlluxioURI> changedFiles,
ExecutorService executorService)
Actively sync metadata, based on a list of changed files.
|
void |
FileSystemMaster.activeSyncMetadata(AlluxioURI path,
Collection<AlluxioURI> changedFiles,
ExecutorService executorService)
Starts a batch sync with a list of changed files passed in.
|
void |
DefaultFileSystemMaster.checkAccess(AlluxioURI path,
CheckAccessContext context) |
void |
FileSystemMaster.checkAccess(AlluxioURI path,
CheckAccessContext context)
Checks access to path.
|
List<AlluxioURI> |
DefaultFileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyContext context) |
List<AlluxioURI> |
FileSystemMaster.checkConsistency(AlluxioURI path,
CheckConsistencyContext context)
Checks the consistency of the files and directories in the subtree under the path.
|
void |
UfsSyncChecker.checkDirectory(InodeDirectory inode,
AlluxioURI alluxioUri)
Check if immediate children of directory are in sync with UFS.
|
void |
DefaultFileSystemMaster.completeFile(AlluxioURI path,
CompleteFileContext context) |
void |
FileSystemMaster.completeFile(AlluxioURI path,
CompleteFileContext context)
Completes a file.
|
protected FileSystemMasterAuditContext |
DefaultFileSystemMaster.createAuditContext(String command,
AlluxioURI srcPath,
AlluxioURI dstPath,
Inode srcInode)
Creates a
FileSystemMasterAuditContext instance. |
long |
DefaultFileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryContext context) |
long |
FileSystemMaster.createDirectory(AlluxioURI path,
CreateDirectoryContext context)
Creates a directory for a given path.
|
FileInfo |
DefaultFileSystemMaster.createFile(AlluxioURI path,
CreateFileContext context) |
FileInfo |
FileSystemMaster.createFile(AlluxioURI path,
CreateFileContext context)
Creates a file (not a directory) for a given path.
|
protected LockingScheme |
DefaultFileSystemMaster.createSyncLockingScheme(AlluxioURI path,
FileSystemMasterCommonPOptions options,
DescendantType descendantType) |
void |
DefaultFileSystemMaster.delete(AlluxioURI path,
DeleteContext context) |
void |
FileSystemMaster.delete(AlluxioURI path,
DeleteContext context)
Deletes a given path.
|
void |
SafeUfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode) |
void |
UfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode)
Deletes a path if not covered by a recursive delete.
|
void |
NoopUfsDeleter.delete(AlluxioURI alluxioUri,
Inode inode) |
boolean |
DefaultFileSystemMaster.exists(AlluxioURI path,
ExistsContext context) |
boolean |
FileSystemMaster.exists(AlluxioURI path,
ExistsContext context)
Checks path exists.
|
void |
DefaultFileSystemMaster.free(AlluxioURI path,
FreeContext context) |
void |
FileSystemMaster.free(AlluxioURI path,
FreeContext context)
Frees or evicts all of the blocks of the file from alluxio storage.
|
MountPointInfo |
DefaultFileSystemMaster.getDisplayMountPointInfo(AlluxioURI path) |
MountPointInfo |
FileSystemMaster.getDisplayMountPointInfo(AlluxioURI path)
Gets the mount point information of an Alluxio path for display purpose.
|
List<FileBlockInfo> |
DefaultFileSystemMaster.getFileBlockInfoList(AlluxioURI path) |
List<FileBlockInfo> |
FileSystemMaster.getFileBlockInfoList(AlluxioURI path)
Gets the
FileBlockInfo for all blocks of a file. |
long |
DefaultFileSystemMaster.getFileId(AlluxioURI path) |
long |
FileSystemMaster.getFileId(AlluxioURI path)
Returns the file id for a given path.
|
FileInfo |
DefaultFileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusContext context) |
FileInfo |
FileSystemMaster.getFileInfo(AlluxioURI path,
GetStatusContext context)
Returns the
FileInfo for a given path. |
long |
DefaultFileSystemMaster.getMountIdFromUfsPath(AlluxioURI ufsPath) |
long |
FileSystemMaster.getMountIdFromUfsPath(AlluxioURI ufsPath)
Returns the mount id according to the ufs path.
|
long |
DefaultFileSystemMaster.getNewBlockIdForFile(AlluxioURI path) |
long |
FileSystemMaster.getNewBlockIdForFile(AlluxioURI path)
Gets a new block id for the next block of a given file to write to.
|
static com.codahale.metrics.Counter |
DefaultFileSystemMaster.Metrics.getUfsOpsSavedCounter(AlluxioURI ufsUri,
DefaultFileSystemMaster.Metrics.UFSOps ufsOp)
Get operations saved per ufs counter.
|
boolean |
UfsSyncChecker.isDirectoryInSync(AlluxioURI alluxioUri)
Based on directories for which
UfsSyncChecker.checkDirectory(InodeDirectory, AlluxioURI) was called, this
method returns whether any un-synced entries were found. |
List<FileInfo> |
DefaultFileSystemMaster.listStatus(AlluxioURI path,
ListStatusContext context) |
List<FileInfo> |
FileSystemMaster.listStatus(AlluxioURI path,
ListStatusContext context)
Returns a list of
FileInfo for a given path. |
void |
DefaultFileSystemMaster.listStatus(AlluxioURI path,
ListStatusContext context,
ResultStream<FileInfo> resultStream) |
void |
FileSystemMaster.listStatus(AlluxioURI path,
ListStatusContext context,
ResultStream<FileInfo> resultStream)
Enumerates given path to given batch tracker.
|
protected void |
DefaultFileSystemMaster.loadMetadataIfNotExist(RpcContext rpcContext,
AlluxioURI path,
LoadMetadataContext context)
Loads metadata for the path if it is (non-existing || load direct children is set).
|
MetadataSyncLockManager.MetadataSyncPathList |
MetadataSyncLockManager.lockPath(AlluxioURI uri)
Acquire locks for a given path before metadata sync.
|
void |
DefaultFileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountContext context) |
void |
FileSystemMaster.mount(AlluxioURI alluxioPath,
AlluxioURI ufsPath,
MountContext context)
Mounts a UFS path onto an Alluxio path.
|
void |
DefaultFileSystemMaster.needsSync(AlluxioURI path) |
void |
FileSystemMaster.needsSync(AlluxioURI path)
Mark a path as needed synchronization with the UFS, when this path or any
of its children are accessed, a sync with the UFS will be performed.
|
void |
DefaultFileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameContext context) |
void |
FileSystemMaster.rename(AlluxioURI srcPath,
AlluxioURI dstPath,
RenameContext context)
Renames a file to a destination.
|
AlluxioURI |
DefaultFileSystemMaster.reverseResolve(AlluxioURI ufsUri) |
AlluxioURI |
FileSystemMaster.reverseResolve(AlluxioURI ufsUri)
Reverse path resolve a ufs uri to an Alluxio path.
|
void |
DefaultFileSystemMaster.scheduleAsyncPersistence(AlluxioURI path,
ScheduleAsyncPersistenceContext context) |
void |
FileSystemMaster.scheduleAsyncPersistence(AlluxioURI path,
ScheduleAsyncPersistenceContext context)
Schedules a file for async persistence.
|
void |
DefaultFileSystemMaster.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclContext context) |
void |
FileSystemMaster.setAcl(AlluxioURI path,
SetAclAction action,
List<AclEntry> entries,
SetAclContext context)
Sets the ACL for a path.
|
void |
DefaultFileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeContext context) |
void |
FileSystemMaster.setAttribute(AlluxioURI path,
SetAttributeContext options)
Sets the file attribute.
|
FileSystemMasterAuditContext |
FileSystemMasterAuditContext.setDstPath(AlluxioURI dstPath)
Sets mDstPath field.
|
FileSystemMasterAuditContext |
FileSystemMasterAuditContext.setSrcPath(AlluxioURI srcPath)
Sets mSrcPath field.
|
void |
DefaultFileSystemMaster.startSync(AlluxioURI syncPoint) |
void |
FileSystemMaster.startSync(AlluxioURI alluxioURI)
starts active sync on a specified alluxioURI.
|
void |
DefaultFileSystemMaster.stopSync(AlluxioURI syncPoint) |
void |
FileSystemMaster.stopSync(AlluxioURI alluxioURI)
stops active sync on a specific syncpoint.
|
void |
DefaultFileSystemMaster.unmount(AlluxioURI alluxioPath) |
void |
FileSystemMaster.unmount(AlluxioURI alluxioPath)
Unmounts a UFS path previously mounted onto an Alluxio path.
|
void |
DefaultFileSystemMaster.updateMount(AlluxioURI alluxioPath,
MountContext context) |
void |
FileSystemMaster.updateMount(AlluxioURI alluxioPath,
MountContext context)
Update properties of an Alluxio mount point.
|
void |
DefaultFileSystemMaster.updateUfsMode(AlluxioURI ufsPath,
UfsMode ufsMode) |
void |
FileSystemMaster.updateUfsMode(AlluxioURI ufsPath,
UfsMode ufsMode)
Update the operation mode for the given ufs path under one or more mount points.
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultFileSystemMaster.activeSyncMetadata(AlluxioURI path,
Collection<AlluxioURI> changedFiles,
ExecutorService executorService)
Actively sync metadata, based on a list of changed files.
|
void |
FileSystemMaster.activeSyncMetadata(AlluxioURI path,
Collection<AlluxioURI> changedFiles,
ExecutorService executorService)
Starts a batch sync with a list of changed files passed in.
|
Constructor and Description |
---|
PersistJob(long id,
long fileId,
AlluxioURI uri,
String tempUfsPath,
ExponentialTimer timer)
Creates a new instance of
PersistJob . |
Constructor and Description |
---|
SafeUfsDeleter(MountTable mountTable,
ReadOnlyInodeStore inodeStore,
List<Pair<AlluxioURI,LockedInodePath>> inodes,
DeletePOptions deleteOptions)
Creates a new instance of
SafeUfsDeleter . |
Modifier and Type | Method and Description |
---|---|
List<AlluxioURI> |
ActiveSyncManager.getFilterList(long mountId)
Get the filter list associated with mount Id.
|
Modifier and Type | Method and Description |
---|---|
boolean |
ActiveSyncManager.isSyncPoint(AlluxioURI syncPoint) |
boolean |
ActiveSyncManager.isUnderSyncPoint(AlluxioURI path)
Check if a URI is actively synced.
|
void |
ActiveSyncManager.recoverFromStartSync(AlluxioURI uri,
long mountId)
Recover from start sync operation.
|
void |
ActiveSyncManager.recoverFromStopSync(AlluxioURI uri)
Recover from a stop sync operation.
|
void |
ActiveSyncManager.startSyncAndJournal(RpcContext rpcContext,
AlluxioURI syncPoint)
Start active sync on a URI and journal the add entry.
|
void |
ActiveSyncManager.stopSyncAndJournal(RpcContext rpcContext,
AlluxioURI syncPoint)
Stop active sync on a URI and journal the remove entry.
|
Modifier and Type | Method and Description |
---|---|
void |
AsyncPersistHandler.scheduleAsyncPersistence(AlluxioURI path)
Schedules a file for async persistence.
|
void |
DefaultAsyncPersistHandler.scheduleAsyncPersistence(AlluxioURI path) |
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
LockedInodePath.mUri
Uri for the path represented.
|
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
LockingScheme.getPath() |
AlluxioURI |
InodeTree.getPath(InodeView inode)
Returns the path for a particular inode.
|
AlluxioURI |
InodeTree.getPath(long id)
Returns the path for a particular inode id.
|
AlluxioURI |
FileSystemMasterView.getPath(long fileId)
Gets the path of a file with the given id.
|
AlluxioURI |
MountTable.Resolution.getUfsMountPointUri() |
AlluxioURI |
LockedInodePath.getUri() |
AlluxioURI |
MountTable.Resolution.getUri() |
AlluxioURI |
MountTable.ReverseResolution.getUri() |
Modifier and Type | Method and Description |
---|---|
void |
MountTable.add(java.util.function.Supplier<JournalContext> journalContext,
AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountPOptions options)
Mounts the given UFS path at the given Alluxio path.
|
void |
AsyncUfsAbsentPathCache.addSinglePath(AlluxioURI path) |
void |
UfsAbsentPathCache.addSinglePath(AlluxioURI path)
Add a single path to the absent cache synchronously.
|
void |
NoopUfsAbsentPathCache.addSinglePath(AlluxioURI path) |
void |
MountTable.addValidated(java.util.function.Supplier<JournalContext> journalContext,
AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountPOptions options)
Inserts an entry into the mount table.
|
void |
MountTable.checkUnderWritableMountPoint(AlluxioURI alluxioUri)
Checks to see if a write operation is allowed for the specified Alluxio path, by determining
if it is under a readonly mount point.
|
boolean |
MountTable.containsMountPoint(AlluxioURI uri,
boolean containsSelf) |
boolean |
MountTable.delete(java.util.function.Supplier<JournalContext> journalContext,
AlluxioURI uri,
boolean checkNestedMount)
Unmounts the given Alluxio path.
|
List<MountInfo> |
MountTable.findChildrenMountPoints(AlluxioURI uri,
boolean containsSelf)
Returns the mount points under the specified path.
|
List<String> |
LazyUfsBlockLocationCache.get(long blockId,
AlluxioURI fileUri,
long offset) |
List<String> |
UfsBlockLocationCache.get(long blockId,
AlluxioURI fileUri,
long offset)
If the locations exist in the cache, return them, otherwise, retrieves the block locations
from UFS, and caches the result.
|
List<FileBlockInfo> |
FileSystemMasterView.getFileBlockInfoList(AlluxioURI path) |
long |
FileSystemMasterView.getFileId(AlluxioURI path)
Returns the file id for a given path.
|
MountInfo |
MountTable.getMountInfo(AlluxioURI uri)
Gets mount information for the path.
|
String |
MountTable.getMountPoint(AlluxioURI uri)
Returns the closest ancestor mount point the given path is nested under.
|
Optional<Pair<Long,Long>> |
UfsSyncPathCache.getSyncTimesForPath(AlluxioURI path)
Get sync times for a given path if they exist in the cache.
|
boolean |
InodeTree.inodePathExists(AlluxioURI uri) |
boolean |
AsyncUfsAbsentPathCache.isAbsentSince(AlluxioURI path,
long absentSince) |
boolean |
UfsAbsentPathCache.isAbsentSince(AlluxioURI path,
long absentSince)
Returns true if the given path was found to be absent since absentSince, according to this
cache.
|
boolean |
NoopUfsAbsentPathCache.isAbsentSince(AlluxioURI path,
long absentSince) |
boolean |
MountTable.isMountPoint(AlluxioURI uri) |
LockedInodePath |
LockedInodePath.lockDescendant(AlluxioURI descendantUri,
InodeTree.LockPattern lockPattern)
Locks a descendant of the current path and returns a new locked inode path.
|
LockedInodePath |
InodeTree.lockFullInodePath(AlluxioURI uri,
InodeTree.LockPattern lockPattern,
JournalContext journalContext)
Locks a path and throws an exception if the path does not exist.
|
LockedInodePath |
InodeTree.lockFullInodePath(AlluxioURI uri,
LockingScheme lockScheme,
JournalContext journalContext)
Locks a path and throws an exception if the path does not exist.
|
LockedInodePath |
InodeTree.lockInodePath(AlluxioURI uri,
InodeTree.LockPattern lockPattern,
boolean tryLock,
JournalContext journalContext)
Locks existing inodes on the specified path, in the specified
InodeTree.LockPattern . |
LockedInodePath |
InodeTree.lockInodePath(AlluxioURI uri,
InodeTree.LockPattern lockPattern,
JournalContext journalContext)
Locks existing inodes on the specified path, in the specified
InodeTree.LockPattern . |
InodePathPair |
InodeTree.lockInodePathPair(AlluxioURI path1,
InodeTree.LockPattern lockPattern1,
AlluxioURI path2,
InodeTree.LockPattern lockPattern2,
JournalContext journalContext)
Locks existing inodes on the two specified paths.
|
void |
UfsSyncPathCache.notifyInvalidation(AlluxioURI path)
Notify that a path has been invalidated.
|
alluxio.master.file.meta.SyncState |
UfsSyncPathCache.notifySyncedPath(AlluxioURI path,
DescendantType descendantType,
long startTime,
Long syncTime,
boolean isFile)
Notify sync happened.
|
void |
AsyncUfsAbsentPathCache.processAsync(AlluxioURI path,
List<Inode> prefixInodes) |
void |
UfsAbsentPathCache.processAsync(AlluxioURI path,
List<Inode> prefixInodes)
Processes the given path for the cache.
|
void |
NoopUfsAbsentPathCache.processAsync(AlluxioURI path,
List<Inode> prefixInodes) |
void |
AsyncUfsAbsentPathCache.processExisting(AlluxioURI path) |
void |
UfsAbsentPathCache.processExisting(AlluxioURI path)
Processes the given path that already exists.
|
void |
NoopUfsAbsentPathCache.processExisting(AlluxioURI path) |
MountTable.Resolution |
MountTable.resolve(AlluxioURI uri)
Resolves the given Alluxio path.
|
MountTable.ReverseResolution |
MountTable.reverseResolve(AlluxioURI ufsUri)
Resolves the given Ufs path.
|
SyncCheck |
UfsSyncPathCache.shouldSyncPath(AlluxioURI path,
long intervalMs,
DescendantType descendantType)
Check if sync should happen.
|
void |
MountTable.update(java.util.function.Supplier<JournalContext> journalContext,
AlluxioURI alluxioUri,
long newMountId,
MountPOptions newOptions)
Update the mount point with new options and mount ID.
|
void |
MountTable.validateMountPoint(AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountPOptions options)
Verify if the given (alluxioPath, ufsPath) can be inserted into MountTable.
|
Constructor and Description |
---|
LockedInodePath(AlluxioURI uri,
ReadOnlyInodeStore inodeStore,
InodeLockManager inodeLockManager,
InodeDirectory root,
InodeTree.LockPattern lockPattern,
boolean tryLock,
JournalContext journalContext)
Creates a new locked inode path.
|
LockingScheme(AlluxioURI path,
InodeTree.LockPattern desiredLockPattern,
boolean shouldSync)
Constructs a
LockingScheme . |
LockingScheme(AlluxioURI path,
InodeTree.LockPattern desiredPattern,
FileSystemMasterCommonPOptions options,
UfsSyncPathCache pathCache,
DescendantType descendantType)
Create a new
LockingScheme . |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
MountInfo.getAlluxioUri() |
AlluxioURI |
MountInfo.getUfsUri() |
Constructor and Description |
---|
MountInfo(AlluxioURI alluxioUri,
AlluxioURI ufsUri,
long mountId,
MountPOptions options)
Creates a new instance of
MountInfo . |
Modifier and Type | Method and Description |
---|---|
CmdInfo |
MigrateCliRunner.runDistCp(AlluxioURI srcPath,
AlluxioURI dstPath,
boolean overwrite,
int batchSize,
long jobControlId)
Run a DistCp command.
|
CmdInfo |
DistLoadCliRunner.runDistLoad(int batchSize,
AlluxioURI filePath,
int replication,
Set<String> workerSet,
Set<String> excludedWorkerSet,
Set<String> localityIds,
Set<String> excludedLocalityIds,
boolean directCache,
long jobControlId)
Run a DistLoad command.
|
Constructor and Description |
---|
MergeJournalContext(JournalContext journalContext,
AlluxioURI uri,
java.util.function.UnaryOperator<List<Journal.JournalEntry>> merger)
Constructs a
MergeJournalContext . |
Modifier and Type | Method and Description |
---|---|
static String |
MetricsSystem.escape(AlluxioURI uri)
Escapes a URI, replacing "/" with "%2F".
|
Modifier and Type | Method and Description |
---|---|
static List<URIStatus> |
S3RestUtils.checkStatusesForUploadId(FileSystem metaFs,
FileSystem userFs,
AlluxioURI multipartTempDirUri,
String uploadId)
Fetches and returns the corresponding
URIStatus for both
the multipart upload temp directory and the Alluxio S3 metadata file. |
static void |
S3RestUtils.deleteExistObject(FileSystem fs,
AlluxioURI objectURI)
Delete an existing key.
|
static void |
S3RestUtils.deleteExistObject(FileSystem fs,
AlluxioURI objectURI,
Boolean recursive)
Delete an existing key.
|
void |
CompleteMultipartUploadHandler.CompleteMultipartUploadTask.removePartsDirAndMPMetaFile(AlluxioURI multipartTemporaryDir)
Cleanup the multipart upload temporary folder holding the parts files.
|
void |
S3ObjectTask.CompleteMultipartUploadTask.removePartsDirAndMPMetaFile(AlluxioURI multipartTemporaryDir)
Cleanup the multipart upload temporary folder holding the parts files.
|
static void |
S3RestUtils.setEntityTag(FileSystem fs,
AlluxioURI objectUri,
String entityTag)
This helper method is used to set the ETag xAttr on an object.
|
List<URIStatus> |
CompleteMultipartUploadHandler.CompleteMultipartUploadTask.validateParts(CompleteMultipartUploadRequest request,
String objectPath,
AlluxioURI multipartTemporaryDir)
Validate the parts as part of this multipart uplaod request.
|
List<URIStatus> |
S3ObjectTask.CompleteMultipartUploadTask.validateParts(CompleteMultipartUploadRequest request,
String objectPath,
AlluxioURI multipartTemporaryDir)
Validate the parts as part of this multipart uplaod request.
|
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
Layout.getLocation() |
static AlluxioURI |
CatalogPathUtils.getTablePathInternal(String dbName,
String tableName) |
static AlluxioURI |
CatalogPathUtils.getTablePathUdb(String dbName,
String tableName,
String udbType) |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
HiveLayout.getLocation() |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
TransformContext.generateTransformedPath() |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
UdbContext.getTableLocation(String tableName) |
Modifier and Type | Method and Description |
---|---|
static String |
UdbUtils.mountAlluxioPath(String tableName,
AlluxioURI ufsUri,
AlluxioURI tableUri,
UdbContext udbContext,
UdbConfiguration udbConfiguration)
Mount ufs path to alluxio path.
|
Modifier and Type | Field and Description |
---|---|
protected AlluxioURI |
BaseUnderFileSystem.mUri
The UFS
AlluxioURI used to create this BaseUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
UfsManager.UfsClient.getUfsMountPointUri() |
AlluxioURI |
BaseUnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystemWithLogging.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath)
Returns an
AlluxioURI representation for the UnderFileSystem given a base
UFS URI, and the Alluxio path from the base. |
Modifier and Type | Method and Description |
---|---|
Collection<UfsStatus> |
UfsStatusCache.addChildren(AlluxioURI path,
Collection<UfsStatus> children)
Add a parent-child mapping to the status cache.
|
void |
MasterUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
void |
AbstractUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
void |
UfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Keeps track of a mount id and maps it to its URI in Alluxio and configuration.
|
void |
MasterUfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder) |
void |
AbstractUfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder) |
void |
UfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder)
Keeps track of a mount id and maps it to its URI in Alluxio and configuration and records
the execution process.
|
UfsStatus |
UfsStatusCache.addStatus(AlluxioURI path,
UfsStatus status)
Add a new status to the cache.
|
Collection<UfsStatus> |
UfsStatusCache.fetchChildrenIfAbsent(RpcContext rpcContext,
AlluxioURI path,
MountTable mountTable)
Fetches children of a given alluxio path stores them in the cache, then returns them.
|
Collection<UfsStatus> |
UfsStatusCache.fetchChildrenIfAbsent(RpcContext rpcContext,
AlluxioURI path,
MountTable mountTable,
boolean useFallback)
Fetches children of a given alluxio path, stores them in the cache, then returns them.
|
UfsStatus |
UfsStatusCache.fetchStatusIfAbsent(AlluxioURI path,
MountTable mountTable)
Attempts to return a status from the cache.
|
Collection<UfsStatus> |
UfsStatusCache.getChildren(AlluxioURI path)
Get the child
UfsStatus es from a given AlluxioURI . |
UfsStatus |
UfsStatusCache.getStatus(AlluxioURI path)
Get the UfsStatus from a given AlluxioURI.
|
Optional<UfsStatus> |
UfsStatusCache.hasStatus(AlluxioURI path)
Check if a status has been loaded in the cache for the given AlluxioURI.
|
Future<Collection<UfsStatus>> |
UfsStatusCache.prefetchChildren(AlluxioURI path,
MountTable mountTable)
Submit a request to asynchronously fetch the statuses corresponding to a given directory.
|
UfsStatus |
UfsStatusCache.remove(AlluxioURI path)
Remove a status from the cache.
|
AlluxioURI |
BaseUnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystemWithLogging.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath) |
AlluxioURI |
UnderFileSystem.resolveUri(AlluxioURI ufsBaseUri,
String alluxioPath)
Returns an
AlluxioURI representation for the UnderFileSystem given a base
UFS URI, and the Alluxio path from the base. |
void |
MasterUfsManager.setUfsMode(java.util.function.Supplier<JournalContext> journalContext,
AlluxioURI ufsPath,
UfsMode ufsMode)
Set the operation mode the given physical ufs.
|
void |
BaseUnderFileSystem.startSync(AlluxioURI uri) |
void |
UnderFileSystemWithLogging.startSync(AlluxioURI uri) |
void |
UnderFileSystem.startSync(AlluxioURI uri)
Add Sync Point.
|
void |
BaseUnderFileSystem.stopSync(AlluxioURI uri) |
void |
UnderFileSystemWithLogging.stopSync(AlluxioURI uri) |
void |
UnderFileSystem.stopSync(AlluxioURI uri)
Stop Sync Point.
|
Constructor and Description |
---|
BaseUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
BaseUnderFileSystem . |
ConsistentUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Creates a new
ConsistentUnderFileSystem for the given uri. |
ObjectUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
ObjectUnderFileSystem . |
UfsClient(java.util.function.Supplier<UnderFileSystem> ufsSupplier,
AlluxioURI ufsMountPointUri) |
Modifier and Type | Method and Description |
---|---|
static AbfsUnderFileSystem |
AbfsUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Creates a new
AbfsUnderFileSystem instance. |
Constructor and Description |
---|
AbfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new HDFS
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static AdlUnderFileSystem |
AdlUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Adl
UnderFileSystem . |
Constructor and Description |
---|
AdlUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration adlConf)
Constructs a new Adl
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static CephFSUnderFileSystem |
CephFSUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new CephFS
UnderFileSystem instance. |
Constructor and Description |
---|
CephFSUnderFileSystem(AlluxioURI ufsUri,
com.ceph.fs.CephMount mount,
UnderFileSystemConfiguration conf)
Constructs a new CephFS
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static CephfsHadoopUnderFileSystem |
CephfsHadoopUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new cephfs-hadoop
UnderFileSystem instance. |
Constructor and Description |
---|
CephfsHadoopUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new Cephfs-Hadoop
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static COSUnderFileSystem |
COSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
COSUnderFileSystem . |
Constructor and Description |
---|
COSUnderFileSystem(AlluxioURI uri,
com.qcloud.cos.COSClient client,
String bucketName,
String appId,
UnderFileSystemConfiguration conf)
Constructor for
COSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static CosnUnderFileSystem |
CosnUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new Cosn
UnderFileSystem instance. |
Constructor and Description |
---|
CosnUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new COSN
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static GCSUnderFileSystem |
GCSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
GCSUnderFileSystem . |
Constructor and Description |
---|
GCSUnderFileSystem(AlluxioURI uri,
org.jets3t.service.impl.rest.httpclient.GoogleStorageService googleStorageService,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
GCSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static GCSV2UnderFileSystem |
GCSV2UnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
GCSV2UnderFileSystem . |
Constructor and Description |
---|
GCSV2UnderFileSystem(AlluxioURI uri,
com.google.cloud.storage.Storage storageClient,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
GCSV2UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static HdfsUnderFileSystem |
HdfsUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new HDFS
UnderFileSystem instance. |
void |
NoopHdfsActiveSyncProvider.startSync(AlluxioURI ufsUri) |
void |
HdfsUnderFileSystem.startSync(AlluxioURI ufsUri) |
void |
HdfsActiveSyncProvider.startSync(AlluxioURI ufsUri)
start syncing on a ufs uri.
|
void |
NoopHdfsActiveSyncProvider.stopSync(AlluxioURI ufsUri) |
void |
HdfsUnderFileSystem.stopSync(AlluxioURI ufsUri) |
void |
HdfsActiveSyncProvider.stopSync(AlluxioURI ufsUri)
stop syncing on a ufs uri.
|
Constructor and Description |
---|
HdfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new HDFS
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
void |
SupportedHdfsActiveSyncProvider.startSync(AlluxioURI ufsUri)
startSync on a ufs uri.
|
void |
SupportedHdfsActiveSyncProvider.stopSync(AlluxioURI ufsUri)
stop sync on a ufs uri.
|
Modifier and Type | Method and Description |
---|---|
protected static KodoUnderFileSystem |
KodoUnderFileSystem.creatInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
KodoUnderFileSystem(AlluxioURI uri,
KodoClient kodoclient,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
LocalUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs a new
LocalUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static OBSUnderFileSystem |
OBSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
OBSUnderFileSystem . |
Constructor and Description |
---|
OBSUnderFileSystem(AlluxioURI uri,
com.obs.services.ObsClient obsClient,
String bucketName,
String bucketType,
UnderFileSystemConfiguration conf)
Constructor for
OBSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static OSSUnderFileSystem |
OSSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
OSSUnderFileSystem . |
Constructor and Description |
---|
OSSUnderFileSystem(AlluxioURI uri,
com.aliyun.oss.OSS ossClient,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
OSSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static OzoneUnderFileSystem |
OzoneUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new Ozone
UnderFileSystem instance. |
Constructor and Description |
---|
OzoneUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new Ozone
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static S3AUnderFileSystem |
S3AUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
S3AUnderFileSystem . |
Constructor and Description |
---|
S3AUnderFileSystem(AlluxioURI uri,
com.amazonaws.services.s3.AmazonS3 amazonS3Client,
String bucketName,
ExecutorService executor,
com.amazonaws.services.s3.transfer.TransferManager transferManager,
UnderFileSystemConfiguration conf,
boolean streamingUploadEnabled)
Constructor for
S3AUnderFileSystem . |
Constructor and Description |
---|
SwiftUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new Swift
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static WasbUnderFileSystem |
WasbUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Wasb
UnderFileSystem . |
Constructor and Description |
---|
WasbUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration wasbConf)
Constructs a new Wasb
UnderFileSystem . |
Constructor and Description |
---|
WebUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs a new
WebUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static String |
UnderFileSystemUtils.getBucketName(AlluxioURI uri) |
Modifier and Type | Method and Description |
---|---|
static AlluxioURI |
PathUtils.findLowestCommonAncestor(Collection<AlluxioURI> paths) |
Modifier and Type | Method and Description |
---|---|
static AlluxioURI |
PathUtils.findLowestCommonAncestor(Collection<AlluxioURI> paths) |
Modifier and Type | Method and Description |
---|---|
AlluxioURI |
BackupStatus.getBackupUri() |
AlluxioURI |
SyncPointInfo.getSyncPointUri()
Get the uri of the sync point.
|
AlluxioURI |
UfsInfo.getUri() |
Modifier and Type | Method and Description |
---|---|
BackupStatus |
BackupStatus.setBackupUri(AlluxioURI backupUri)
Sets the backup uri.
|
UfsInfo |
UfsInfo.setUri(AlluxioURI uri) |
Constructor and Description |
---|
SyncPointInfo(AlluxioURI syncPoint,
SyncPointInfo.SyncStatus syncStatus)
Constructs a SyncPointInfo object.
|
Copyright © 2023. All Rights Reserved.