Constructor and Description |
---|
S3ASpecificOperations(String testDirectory,
UnderFileSystem ufs,
InstancedConfiguration configuration) |
UnderFileSystemCommonOperations(String ufsPath,
String topLevelTestDirectory,
UnderFileSystem ufs,
InstancedConfiguration configuration) |
Modifier and Type | Class and Description |
---|---|
class |
ManagedBlockingUfsForwarder
Forwarder for
UnderFileSystem objects that works through with ForkJoinPool's
managed blocking. |
Constructor and Description |
---|
ManagedBlockingUfsForwarder(UnderFileSystem ufs)
Creates
ManagedBlockingUfsForwarder instance. |
Modifier and Type | Method and Description |
---|---|
protected void |
NoopUfsManager.connectUfs(UnderFileSystem fs) |
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
MountTable.Resolution.acquireUfsResource() |
Constructor and Description |
---|
EntryOutputStream(UnderFileSystem ufs,
URI log,
JournalFormatter journalFormatter,
UfsJournalWriter journalWriter) |
UfsCheckpointManager(UnderFileSystem ufs,
URI checkpoint,
UfsJournalWriter writer)
Creates a new instance of
UfsCheckpointManager . |
Modifier and Type | Interface and Description |
---|---|
interface |
AtomicFileOutputStreamCallback
A
AtomicFileOutputStreamCallback is the callback interface used when using a
AtomicFileOutputStream . |
Modifier and Type | Class and Description |
---|---|
class |
BaseUnderFileSystem
A base abstract
UnderFileSystem . |
class |
ConsistentUnderFileSystem
Represents a consistent under filesystem
which does not have eventual consistency issues.
|
class |
ObjectUnderFileSystem
An object based abstract
UnderFileSystem . |
class |
UnderFileSystemWithLogging
This class forwards all calls to the
UnderFileSystem interface to an internal
implementation. |
Modifier and Type | Field and Description |
---|---|
protected ConcurrentHashMap<AbstractUfsManager.Key,UnderFileSystem> |
AbstractUfsManager.mUnderFileSystemMap
Maps from key to
UnderFileSystem instances. |
Modifier and Type | Method and Description |
---|---|
static UnderFileSystem |
UnderFileSystem.Factory.create(String path,
AlluxioConfiguration conf)
Creates the
UnderFileSystem instance according to its UFS path. |
UnderFileSystem |
UnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf)
Creates a new client for accessing the given path.
|
static UnderFileSystem |
UnderFileSystem.Factory.create(String path,
UnderFileSystemConfiguration ufsConf)
Creates a client for operations involved with the under file system.
|
static UnderFileSystem |
UnderFileSystem.Factory.createForRoot(AlluxioConfiguration conf) |
UnderFileSystem |
UnderFileSystemWithLogging.getUnderFileSystem()
This is only used in the test.
|
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
UfsManager.UfsClient.acquireUfsResource() |
Modifier and Type | Method and Description |
---|---|
protected void |
JobUfsManager.connectUfs(UnderFileSystem fs) |
protected void |
MasterUfsManager.connectUfs(UnderFileSystem fs) |
protected void |
WorkerUfsManager.connectUfs(UnderFileSystem fs) |
protected abstract void |
AbstractUfsManager.connectUfs(UnderFileSystem fs)
Takes any necessary actions required to establish a connection to the under file system.
|
Constructor and Description |
---|
UfsClient(java.util.function.Supplier<UnderFileSystem> ufsSupplier,
AlluxioURI ufsMountPointUri) |
Modifier and Type | Class and Description |
---|---|
class |
AbfsUnderFileSystem
A Microsoft Azure Data Lake Storage Gen2 Implementation.
|
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AbfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
AdlUnderFileSystem
A Microsoft Azure Data Lake Storage Gen 1 Implementation.
|
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AdlUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
CephFSUnderFileSystem
CephFS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CephFSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
COSUnderFileSystem
Tencent Cloud COS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
COSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
GCSUnderFileSystem
Google Cloud Storage
UnderFileSystem implementation based on the jets3t library. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
GCSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
GCSV2UnderFileSystem
GCS FS
UnderFileSystem implementation based on the Google cloud storage library. |
Modifier and Type | Class and Description |
---|---|
class |
HdfsUnderFileSystem
HDFS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
HdfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
KodoUnderFileSystem
Qiniu Kodo
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
KodoUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
LocalUnderFileSystem
Local FS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
LocalUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
OSSUnderFileSystem
Aliyun OSS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OSSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
S3AUnderFileSystem
S3
UnderFileSystem implementation based on the aws-java-sdk-s3 library. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
S3AUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
SwiftUnderFileSystem
OpenStack Swift
UnderFileSystem implementation based on the JOSS library. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
SwiftUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
WasbUnderFileSystem
An
UnderFileSystem uses the Microsoft Azure Blob Storage. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
WasbUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
WebUnderFileSystem
Web
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
WebUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Method and Description |
---|---|
static void |
UnderFileSystemUtils.deleteDirIfExists(UnderFileSystem ufs,
String path)
Deletes the directory at the given path if it exists.
|
static void |
UnderFileSystemUtils.deleteFileIfExists(UnderFileSystem ufs,
String path)
Deletes the specified path from the specified under file system if it is a file and exists.
|
static boolean |
UnderFileSystemUtils.isCephFS(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isGcs(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isHdfs(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isLocal(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isOss(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isS3(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isSwift(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isWeb(UnderFileSystem ufs) |
static void |
UnderFileSystemUtils.mkdirIfNotExists(UnderFileSystem ufs,
String path)
Attempts to create the directory if it does not already exist.
|
static void |
UnderFileSystemUtils.touch(UnderFileSystem ufs,
String path)
Creates an empty file.
|
Modifier and Type | Method and Description |
---|---|
InputStream |
UfsInputStreamCache.acquire(UnderFileSystem ufs,
String path,
long fileId,
OpenOptions openOptions)
Acquires an input stream.
|
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
BlockWriteRequestContext.getUfsResource() |
CloseableResource<UnderFileSystem> |
UfsFileWriteRequestContext.getUfsResource() |
Modifier and Type | Method and Description |
---|---|
void |
BlockWriteRequestContext.setUfsResource(CloseableResource<UnderFileSystem> ufsResource) |
void |
UfsFileWriteRequestContext.setUfsResource(CloseableResource<UnderFileSystem> ufsResource) |
Copyright © 2023. All Rights Reserved.