Constructor and Description |
---|
FuseShell(FileSystem fs,
AlluxioConfiguration conf)
Creates a new instance of
FuseShell . |
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
AbstractFuseShellCommand.mFileSystem |
Constructor and Description |
---|
AbstractFuseShellCommand(FileSystem fileSystem,
AlluxioConfiguration conf,
String commandName) |
MetadataCacheCommand(FileSystem fs,
AlluxioConfiguration conf) |
Constructor and Description |
---|
AbstractMetadataCacheSubCommand(FileSystem fileSystem,
AlluxioConfiguration conf,
String commandName) |
DropAllCommand(FileSystem fs,
AlluxioConfiguration conf,
String parentCommandName) |
DropCommand(FileSystem fs,
AlluxioConfiguration conf,
String parentCommandName) |
SizeCommand(FileSystem fs,
AlluxioConfiguration conf,
String parentCommandName) |
Modifier and Type | Method and Description |
---|---|
static List<AlluxioURI> |
FileSystemShellUtils.getAlluxioURIs(FileSystem alluxioClient,
AlluxioURI inputURI)
Gets all the
AlluxioURI s that match inputURI. |
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
AbstractFileSystemCommand.mFileSystem |
Modifier and Type | Method and Description |
---|---|
static void |
FileSystemCommandUtils.setDirectChildrenLoaded(FileSystem fs,
AlluxioURI path,
boolean directChildrenLoaded)
Sets direct children loaded.
|
static void |
FileSystemCommandUtils.setPinned(FileSystem fs,
AlluxioURI path,
boolean pinned,
List<String> mediumTypes)
Sets pin state for the input path.
|
static void |
FileSystemCommandUtils.setTtl(FileSystem fs,
AlluxioURI path,
long ttlMs,
TtlAction ttlAction)
Sets a new TTL value or unsets an existing TTL value for file at path.
|
Modifier and Type | Class and Description |
---|---|
class |
DelegatingFileSystem
A wrapper of a FileSystem instance.
|
class |
DoraCacheFileSystem
Dora Cache file system implementation.
|
class |
FileSystemCache.InstanceCachingFileSystem
A wrapper class on a FileSystem instance.
|
class |
MetadataCachingFileSystem
FileSystem implementation with the capability of caching metadata of paths.
|
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
DelegatingFileSystem.mDelegatedFileSystem |
Modifier and Type | Method and Description |
---|---|
static FileSystem |
FileSystem.Factory.create() |
static FileSystem |
FileSystem.Factory.create(AlluxioConfiguration alluxioConf) |
static FileSystem |
FileSystem.Factory.create(ClientContext ctx) |
static FileSystem |
FileSystem.Factory.create(FileSystemContext context) |
static FileSystem |
FileSystem.Factory.create(FileSystemContext context,
FileSystemOptions options) |
static FileSystem |
FileSystem.Factory.get() |
FileSystem |
FileSystemCache.get(FileSystemCache.Key key)
Gets a
FileSystem instance from the cache. |
static FileSystem |
FileSystem.Factory.get(Subject subject)
Get a FileSystem from the cache with a given subject.
|
static FileSystem |
FileSystem.Factory.get(Subject subject,
AlluxioConfiguration conf)
Get a FileSystem from the cache with a given subject.
|
FileSystem |
DelegatingFileSystem.getUnderlyingFileSystem() |
Modifier and Type | Method and Description |
---|---|
DoraCacheFileSystem |
DoraCacheFileSystem.DoraCacheFileSystemFactory.createAnInstance(FileSystem fs,
FileSystemContext context) |
static void |
FileSystemUtils.persistAndWait(FileSystem fs,
AlluxioURI uri,
long persistenceWaitTime)
Convenience method for
#persistAndWait(fs, uri, persistenceWaitTime, -1) . |
static void |
FileSystemUtils.persistAndWait(FileSystem fs,
AlluxioURI uri,
long persistenceWaitTime,
int timeoutMs)
Persists the given path to the under file system and returns once the persist is complete.
|
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri)
Shortcut for
waitCompleted(fs, uri, -1, TimeUnit.MILLISECONDS) , i.e., wait for an
indefinite amount of time. |
static boolean |
FileSystemUtils.waitCompleted(FileSystem fs,
AlluxioURI uri,
long timeout,
TimeUnit tunit)
Waits for a file to be marked as completed.
|
static void |
FileSystemUtils.waitForAlluxioPercentage(FileSystem fs,
AlluxioURI uri,
int expectedPercentage)
Waits until the specified file has the desired percentage in Alluxio.
|
Constructor and Description |
---|
DelegatingFileSystem(FileSystem fs)
Wraps a file system instance to forward messages.
|
DoraCacheFileSystem(FileSystem fs,
FileSystemContext context)
Wraps a file system instance to forward messages.
|
DoraCacheFileSystem(FileSystem fs,
FileSystemContext context,
DoraCacheClient doraCacheClient) |
MetadataCachingFileSystem(FileSystem fileSystem,
FileSystemContext context) |
Value(FileSystem fileSystem,
int count) |
Modifier and Type | Class and Description |
---|---|
class |
LocalCacheFileSystem
A FileSystem implementation with a local cache.
|
Constructor and Description |
---|
LocalCacheFileSystem(CacheManager cacheManage,
FileSystem fs,
AlluxioConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
UfsBaseFileSystem
An implementation of the
FileSystem interface that directly interacts with a target
UFS. |
Constructor and Description |
---|
AlluxioReadWorker(int id,
int left,
int right,
ByteBuffer buf,
FileSystem fs) |
AlluxioWriterWorker(int id,
int left,
int right,
ByteBuffer buf,
FileSystem fs) |
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
AlluxioFuse.createBaseFileSystem(FileSystemContext fsContext,
FuseOptions fuseOptions) |
FileSystem |
AlluxioJniFuseFileSystem.getFileSystem()
Get the file system on which FuseFileSystem is based.
|
Modifier and Type | Method and Description |
---|---|
static FileOutStream |
AlluxioFuseUtils.createFile(FileSystem fileSystem,
AuthPolicy authPolicy,
AlluxioURI uri,
CreateFileStatus fileStatus)
Creates a file in alluxio namespace.
|
AlluxioJniFuseFileSystem |
AlluxioFuse.createFuseFileSystem(FileSystemContext fsContext,
FileSystem fs,
FuseOptions fuseOptions)
Create a FuseFileSystem instance.
|
protected AlluxioJniFuseFileSystem |
AlluxioFuse.createJniFuseSystem(FileSystemContext fsContext,
FileSystem fs,
FuseOptions fuseOptions) |
static void |
AlluxioFuseUtils.deletePath(FileSystem fileSystem,
AlluxioURI uri)
Deletes a file or a directory in alluxio namespace.
|
static Optional<URIStatus> |
AlluxioFuseUtils.getPathStatus(FileSystem fileSystem,
AlluxioURI uri)
Gets the path status.
|
static void |
AlluxioFuseUtils.setAttribute(FileSystem fileSystem,
AlluxioURI uri,
SetAttributePOptions options)
Sets attribute for a file.
|
static Optional<URIStatus> |
AlluxioFuseUtils.waitForFileCompleted(FileSystem fileSystem,
AlluxioURI uri)
Waits for the file to complete.
|
Constructor and Description |
---|
AlluxioJniFuseFileSystem(FileSystemContext fsContext,
FileSystem fs,
FuseOptions fuseOptions)
Creates a new instance of
AlluxioJniFuseFileSystem . |
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
LaunchUserGroupAuthPolicy.mFileSystem |
Modifier and Type | Method and Description |
---|---|
static AuthPolicy |
AuthPolicyFactory.create(FileSystem fileSystem,
AlluxioConfiguration conf,
FuseFileSystem fuseFileSystem)
Creates a new instance of
AuthPolicy . |
static SystemUserGroupAuthPolicy |
SystemUserGroupAuthPolicy.create(FileSystem fileSystem,
AlluxioConfiguration conf,
Optional<FuseFileSystem> fuseFileSystem)
Creates a new system auth policy.
|
static LaunchUserGroupAuthPolicy |
LaunchUserGroupAuthPolicy.create(FileSystem fileSystem,
AlluxioConfiguration conf,
Optional<FuseFileSystem> fuseFileSystem)
Creates a new launch user auth policy.
|
static CustomAuthPolicy |
CustomAuthPolicy.create(FileSystem fileSystem,
AlluxioConfiguration conf,
Optional<FuseFileSystem> fuseFileSystem)
Creates a new custom auth policy.
|
Constructor and Description |
---|
LaunchUserGroupAuthPolicy(FileSystem fileSystem,
Optional<FuseFileSystem> fuseFileSystem) |
Modifier and Type | Method and Description |
---|---|
static FusePositionReadOrOutStream |
FusePositionReadOrOutStream.create(FileSystem fileSystem,
AuthPolicy authPolicy,
FuseReadWriteLockManager lockManager,
AlluxioURI uri,
int flags,
long mode)
Creates a
FuseFileInOrOutStream . |
static FuseFileOutStream |
FuseFileOutStream.create(FileSystem fileSystem,
AuthPolicy authPolicy,
FuseReadWriteLockManager lockManager,
AlluxioURI uri,
int flags,
long mode)
Creates a
FuseFileInOrOutStream . |
static FuseFileInOrOutStream |
FuseFileInOrOutStream.create(FileSystem fileSystem,
AuthPolicy authPolicy,
FuseReadWriteLockManager lockManager,
AlluxioURI uri,
int flags,
long mode)
Creates a
FuseFileInOrOutStream . |
static FusePositionReader |
FusePositionReader.create(FileSystem fileSystem,
FuseReadWriteLockManager lockManager,
AlluxioURI uri) |
static FuseFileInStream |
FuseFileInStream.create(FileSystem fileSystem,
FuseReadWriteLockManager lockManager,
AlluxioURI uri)
Creates a
FuseFileInStream . |
Constructor and Description |
---|
SimpleFuseStreamFactory(FileSystem fileSystem,
AuthPolicy authPolicy)
Creates an instance of
FuseStreamFactory for
creating fuse streams. |
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
AbstractFileSystem.mFileSystem |
Constructor and Description |
---|
AbstractFileSystem(FileSystem fileSystem)
Constructs a new
AbstractFileSystem instance with specified a FileSystem
handler for tests. |
BaseHdfsFileInputStream(FileSystem fs,
AlluxioURI uri,
org.apache.hadoop.fs.FileSystem.Statistics stats)
Constructs a new stream for reading a file from HDFS.
|
FileSystem(FileSystem fileSystem)
Constructs a new
FileSystem instance with a
specified FileSystem handler for tests. |
HdfsFileInputStream(FileSystem fs,
AlluxioURI uri,
org.apache.hadoop.fs.FileSystem.Statistics stats)
Constructs a new stream for reading a file from HDFS.
|
Modifier and Type | Method and Description |
---|---|
FileSystem |
JobServerContext.getFileSystem() |
Constructor and Description |
---|
JobServerContext(FileSystem filesystem,
FileSystemContext fsContext,
UfsManager ufsManager)
Creates a new instance of
JobServerContext . |
Modifier and Type | Method and Description |
---|---|
FileSystem |
MultiMasterLocalAlluxioCluster.getClient() |
FileSystem |
MultiMasterEmbeddedJournalLocalAlluxioCluster.getClient() |
FileSystem |
LocalAlluxioCluster.getClient() |
FileSystem |
ClientPool.getClient()
Returns a
FileSystem client. |
FileSystem |
LocalAlluxioMaster.getClient() |
abstract FileSystem |
AbstractLocalAlluxioCluster.getClient()
Returns a
FileSystem client. |
FileSystem |
MultiMasterLocalAlluxioCluster.getClient(FileSystemContext context) |
FileSystem |
MultiMasterEmbeddedJournalLocalAlluxioCluster.getClient(FileSystemContext context) |
FileSystem |
LocalAlluxioCluster.getClient(FileSystemContext context) |
FileSystem |
ClientPool.getClient(FileSystemContext context)
Returns a
FileSystem client using a specific context. |
FileSystem |
LocalAlluxioMaster.getClient(FileSystemContext context) |
abstract FileSystem |
AbstractLocalAlluxioCluster.getClient(FileSystemContext context) |
Modifier and Type | Method and Description |
---|---|
protected abstract void |
FsTestOp.apply(FileSystem fs) |
protected abstract void |
FsTestOp.check(FileSystem fs) |
static void |
Utils.createFile(FileSystem fs,
AlluxioURI path)
Creates a file at the given path.
|
static void |
Utils.createFile(FileSystem fs,
AlluxioURI path,
CreateFilePOptions options)
Creates a file at the given path.
|
Modifier and Type | Method and Description |
---|---|
void |
CreateDirectory.apply(FileSystem fs) |
void |
Delete.apply(FileSystem fs) |
void |
Mount.apply(FileSystem fs) |
void |
SetAcl.apply(FileSystem fs) |
void |
AsyncPersist.apply(FileSystem fs) |
void |
Rename.apply(FileSystem fs) |
void |
PersistDirectory.apply(FileSystem fs) |
void |
CreateFile.apply(FileSystem fs) |
void |
CreateDirectory.check(FileSystem fs) |
void |
Delete.check(FileSystem fs) |
void |
Mount.check(FileSystem fs) |
void |
SetAcl.check(FileSystem fs) |
void |
AsyncPersist.check(FileSystem fs) |
void |
Rename.check(FileSystem fs) |
void |
PersistDirectory.check(FileSystem fs) |
void |
CreateFile.check(FileSystem fs) |
Constructor and Description |
---|
JobMaster(MasterContext masterContext,
FileSystem filesystem,
FileSystemContext fsContext,
UfsManager ufsManager)
Creates a new instance of
JobMaster . |
Modifier and Type | Method and Description |
---|---|
static void |
DistributedCmdMetrics.batchIncrementForCompleteStatusWithRetry(BatchedJobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for batch config for complete status.
|
static long |
DistributedCmdMetrics.getFileSize(String filePath,
FileSystem fileSystem,
RetryPolicy retryPolicy)
get file size for a given filePath, return 0 if exceeding retries.
|
static void |
DistributedCmdMetrics.incrementForAllConfigsCompleteStatus(JobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for both batch and non-batch configs for COMPLETE status.
|
static void |
DistributedCmdMetrics.incrementForCompleteStatusWithRetry(JobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for non-batch config for complete status.
|
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
AbstractCmdRunner.mFileSystem |
Modifier and Type | Method and Description |
---|---|
FileSystem |
MultiProcessCluster.getFileSystemClient() |
FileSystem |
Clients.getFileSystemClient() |
Constructor and Description |
---|
Clients(FileSystem fs,
FileSystemMasterClient fsMaster,
MetaMasterClient metaMaster,
BlockMasterClient blockMaster) |
Modifier and Type | Method and Description |
---|---|
static FileSystem |
S3RestUtils.createFileSystemForUser(String user,
FileSystem fs) |
FileSystem |
S3Handler.getMetaFS()
Get system user FileSystem object.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
MultipartUploadCleaner.apply(FileSystem metaFs,
FileSystem userFs,
String bucket,
String object,
String uploadId)
Schedule a task to clean multipart upload.
|
static void |
MultipartUploadCleaner.cancelAbort(FileSystem metaFs,
FileSystem userFs,
String bucket,
String object,
String uploadId)
Cancel schedule task.
|
static void |
S3RestUtils.checkPathIsAlluxioDirectory(FileSystem fs,
String bucketPath,
S3AuditContext auditContext)
Check if a path in alluxio is a directory.
|
static void |
S3RestUtils.checkPathIsAlluxioDirectory(FileSystem fs,
String bucketPath,
S3AuditContext auditContext,
com.google.common.cache.Cache<String,Boolean> bucketPathCache)
Check if a path in alluxio is a directory.
|
static List<URIStatus> |
S3RestUtils.checkStatusesForUploadId(FileSystem metaFs,
FileSystem userFs,
AlluxioURI multipartTempDirUri,
String uploadId)
Fetches and returns the corresponding
URIStatus for both
the multipart upload temp directory and the Alluxio S3 metadata file. |
static FileSystem |
S3RestUtils.createFileSystemForUser(String user,
FileSystem fs) |
static void |
S3RestUtils.deleteExistObject(FileSystem fs,
AlluxioURI objectURI)
Delete an existing key.
|
static void |
S3RestUtils.deleteExistObject(FileSystem fs,
AlluxioURI objectURI,
Boolean recursive)
Delete an existing key.
|
static void |
S3RestUtils.setEntityTag(FileSystem fs,
AlluxioURI objectUri,
String entityTag)
This helper method is used to set the ETag xAttr on an object.
|
long |
MultipartUploadCleaner.tryAbortMultipartUpload(FileSystem metaFs,
FileSystem userFs,
String bucket,
String object,
String uploadId)
Try to abort a multipart upload if it was timeout.
|
Constructor and Description |
---|
AbortTask(FileSystem metaFs,
FileSystem userFs,
String bucket,
String object,
String uploadId)
Creates a new instance of
MultipartUploadCleaner.AbortTask . |
CompleteMultipartUploadHandler(FileSystem fs,
String baseUri)
Creates a new instance of
CompleteMultipartUploadHandler . |
CompleteMultipartUploadTask(FileSystem metaFs,
FileSystem userFs,
String bucket,
String object,
String uploadId,
String body)
Creates a new instance of
CompleteMultipartUploadHandler.CompleteMultipartUploadTask . |
Constructor and Description |
---|
WorkerWebServer(InetSocketAddress webAddress,
WorkerProcess workerProcess,
DataWorker worker,
FileSystem fileSystem)
Creates a new instance of
WorkerWebServer . |
Modifier and Type | Method and Description |
---|---|
FileSystem |
S3NettyHandler.getFileSystemForUser(String user) |
FileSystem |
S3NettyHandler.getFsClient()
Get system user FileSystem object.
|
Modifier and Type | Method and Description |
---|---|
static void |
S3NettyHandler.checkPathIsAlluxioDirectory(FileSystem fs,
String bucketPath,
S3AuditContext auditContext)
Check if a path in alluxio is a directory.
|
static S3NettyHandler |
S3NettyHandler.createHandler(io.netty.channel.ChannelHandlerContext context,
io.netty.handler.codec.http.HttpRequest request,
FileSystem fileSystem,
DoraWorker doraWorker,
AsyncUserAccessAuditLogWriter asyncAuditLogWriter)
Create a S3Handler based on the incoming Request.
|
static void |
S3NettyHandler.setEntityTag(FileSystem fs,
AlluxioURI objectUri,
String entityTag)
This helper method is used to set the ETag xAttr on an object.
|
Constructor and Description |
---|
S3HttpHandler(FileSystem fileSystem,
DoraWorker doraWorker,
AsyncUserAccessAuditLogWriter asyncAuditLogWriter,
ThreadPoolExecutor lightPool,
ThreadPoolExecutor heavyPool)
Constructs an instance of
S3HttpHandler . |
S3HttpPipelineHandler(FileSystem fileSystem,
DoraWorker doraWorker)
Constructs an instance of
S3HttpPipelineHandler . |
S3NettyHandler(String bucket,
String object,
io.netty.handler.codec.http.HttpRequest request,
io.netty.channel.ChannelHandlerContext ctx,
FileSystem fileSystem,
DoraWorker doraWorker,
AsyncUserAccessAuditLogWriter asyncAuditLogWriter)
Constructs an instance of
S3NettyHandler . |
Modifier and Type | Method and Description |
---|---|
static void |
CopyHandler.copy(Route route,
WriteOptions writeOptions,
FileSystem srcFs,
FileSystem dstFs)
Copies a file from source to destination.
|
static void |
DeleteHandler.delete(AlluxioURI path,
FileSystem fs)
This function deletes files/directories.
|
static boolean |
ValidateHandler.validate(Route route,
WriteOptions writeOptions,
FileSystem srcFs,
FileSystem dstFs,
boolean isMove)
Validates a file from source to destination.
|
Copyright © 2023. All Rights Reserved.