Constructor and Description |
---|
S3ASpecificOperations(String testDirectory,
UnderFileSystem ufs,
InstancedConfiguration configuration) |
UnderFileSystemCommonOperations(String ufsPath,
String topLevelTestDirectory,
UnderFileSystem ufs,
InstancedConfiguration configuration) |
Modifier and Type | Field and Description |
---|---|
protected CloseableResource<UnderFileSystem> |
UfsBaseFileSystem.mUfs |
Modifier and Type | Class and Description |
---|---|
class |
ManagedBlockingUfsForwarder
Forwarder for
UnderFileSystem objects that works through with ForkJoinPool's
managed blocking. |
Constructor and Description |
---|
ManagedBlockingUfsForwarder(UnderFileSystem ufs)
Creates
ManagedBlockingUfsForwarder instance. |
Modifier and Type | Method and Description |
---|---|
protected void |
NoopUfsManager.connectUfs(UnderFileSystem fs) |
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
MountTable.Resolution.acquireUfsResource() |
Constructor and Description |
---|
UfsFileIterable(UnderFileSystem fs,
String path,
Optional<String> user,
java.util.function.Predicate<FileInfo> filter)
Creates a new instance of
FileIterable . |
Constructor and Description |
---|
EntryOutputStream(UnderFileSystem ufs,
URI log,
JournalFormatter journalFormatter,
UfsJournalWriter journalWriter) |
UfsCheckpointManager(UnderFileSystem ufs,
URI checkpoint,
UfsJournalWriter writer)
Creates a new instance of
UfsCheckpointManager . |
Modifier and Type | Interface and Description |
---|---|
interface |
AtomicFileOutputStreamCallback
A
AtomicFileOutputStreamCallback is the callback interface used when using a
AtomicFileOutputStream . |
Modifier and Type | Class and Description |
---|---|
class |
BaseUnderFileSystem
A base abstract
UnderFileSystem . |
class |
ConsistentUnderFileSystem
Represents a consistent under filesystem
which does not have eventual consistency issues.
|
class |
ObjectUnderFileSystem
An object based abstract
UnderFileSystem . |
class |
UnderFileSystemWithLogging
This class forwards all calls to the
UnderFileSystem interface to an internal
implementation. |
Modifier and Type | Field and Description |
---|---|
protected ConcurrentHashMap<AbstractUfsManager.Key,UnderFileSystem> |
AbstractUfsManager.mUnderFileSystemMap
Maps from key to
UnderFileSystem instances. |
Modifier and Type | Method and Description |
---|---|
static UnderFileSystem |
UnderFileSystem.Factory.create(String path,
AlluxioConfiguration conf)
Creates the
UnderFileSystem instance according to its UFS path. |
UnderFileSystem |
UnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf)
Creates a new client for accessing the given path.
|
static UnderFileSystem |
UnderFileSystem.Factory.create(String path,
UnderFileSystemConfiguration ufsConf)
Creates a client for operations involved with the under file system.
|
static UnderFileSystem |
UnderFileSystem.Factory.createForRoot(AlluxioConfiguration conf) |
static UnderFileSystem |
UnderFileSystem.Factory.createWithRecorder(String path,
UnderFileSystemConfiguration ufsConf,
Recorder recorder)
Creates a client for operations involved with the under file system and record the
execution process.
|
UnderFileSystem |
AbstractUfsManager.getOrAdd(AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Return a UFS instance if it already exists in the cache, otherwise, creates a new instance and
return it.
|
UnderFileSystem |
UnderFileSystemWithLogging.getUnderFileSystem()
This is only used in the test.
|
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
UfsManager.UfsClient.acquireUfsResource() |
protected Optional<UnderFileSystem> |
AbstractUfsManager.get(AbstractUfsManager.Key key) |
Optional<UnderFileSystem> |
AbstractUfsManager.get(AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Gets an instance for the given UFS URI and configuration, if such exists.
|
Modifier and Type | Method and Description |
---|---|
InputStream |
UfsInputStreamCache.acquire(UnderFileSystem ufs,
String path,
FileId fileId,
OpenOptions openOptions)
Acquires an input stream.
|
protected void |
JobUfsManager.connectUfs(UnderFileSystem fs) |
protected void |
MasterUfsManager.connectUfs(UnderFileSystem fs) |
protected void |
WorkerUfsManager.connectUfs(UnderFileSystem fs) |
protected abstract void |
AbstractUfsManager.connectUfs(UnderFileSystem fs)
Takes any necessary actions required to establish a connection to the under file system.
|
Constructor and Description |
---|
UfsClient(java.util.function.Supplier<UnderFileSystem> ufsSupplier,
AlluxioURI ufsMountPointUri) |
Modifier and Type | Class and Description |
---|---|
class |
AbfsUnderFileSystem
A Microsoft Azure Data Lake Storage Gen2 Implementation.
|
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AbfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
AdlUnderFileSystem
A Microsoft Azure Data Lake Storage Gen 1 Implementation.
|
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AdlUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
CephFSUnderFileSystem
CephFS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CephFSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
CephfsHadoopUnderFileSystem
Cephfs-Hadoop
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CephfsHadoopUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
COSUnderFileSystem
Tencent Cloud COS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
COSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
CosnUnderFileSystem
COSN
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CosNUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
GCSUnderFileSystem
Google Cloud Storage
UnderFileSystem implementation based on the jets3t library. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
GCSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
GCSV2UnderFileSystem
GCS FS
UnderFileSystem implementation based on the Google cloud storage library. |
Modifier and Type | Class and Description |
---|---|
class |
HdfsUnderFileSystem
HDFS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
HdfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
LocalUnderFileSystem
Local FS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
LocalUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
OBSUnderFileSystem
Huawei OBS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OBSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
OSSUnderFileSystem
Aliyun OSS
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OSSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
OzoneUnderFileSystem
Ozone
UnderFileSystem implementation. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OzoneUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
S3AUnderFileSystem
S3
UnderFileSystem implementation based on the aws-java-sdk-s3 library. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
S3AUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Class and Description |
---|---|
class |
WasbUnderFileSystem
An
UnderFileSystem uses the Microsoft Azure Blob Storage. |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
WasbUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Modifier and Type | Method and Description |
---|---|
static void |
UnderFileSystemUtils.deleteDirIfExists(UnderFileSystem ufs,
String path)
Deletes the directory at the given path if it exists.
|
static void |
UnderFileSystemUtils.deleteFileIfExists(UnderFileSystem ufs,
String path)
Deletes the specified path from the specified under file system if it is a file and exists.
|
static boolean |
UnderFileSystemUtils.isCephFS(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isGcs(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isHdfs(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isLocal(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isOss(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isS3(UnderFileSystem ufs) |
static boolean |
UnderFileSystemUtils.isWeb(UnderFileSystem ufs) |
static void |
UnderFileSystemUtils.mkdirIfNotExists(UnderFileSystem ufs,
String path)
Attempts to create the directory if it does not already exist.
|
static void |
UnderFileSystemUtils.touch(UnderFileSystem ufs,
String path)
Creates an empty file.
|
Modifier and Type | Method and Description |
---|---|
protected UnderFileSystem |
PagedDoraWorker.getUfsInstance(String ufsUriStr) |
protected UnderFileSystem |
PagedDoraWorker.getUnderFileSystem(String ufsPath) |
Modifier and Type | Method and Description |
---|---|
protected void |
DoraUfsManager.connectUfs(UnderFileSystem fs) |
static PagedFileReader |
PagedFileReader.create(AlluxioConfiguration conf,
CacheManager cacheManager,
UnderFileSystem ufs,
String fileId,
String ufsPath,
long fileSize,
long startPosition)
Creates a new
PagedFileReader . |
Modifier and Type | Method and Description |
---|---|
CloseableResource<UnderFileSystem> |
UfsFileWriteRequestContext.getUfsResource() |
Modifier and Type | Method and Description |
---|---|
void |
UfsFileWriteRequestContext.setUfsResource(CloseableResource<UnderFileSystem> ufsResource) |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
UfsFileWriteRequestContext.getUnderFileSystem() |
Modifier and Type | Method and Description |
---|---|
void |
UfsFileWriteRequestContext.setUnderFileSystem(UnderFileSystem underFileSystem) |
Copyright © 2023. All Rights Reserved.