Constructor and Description |
---|
HdfsValidationTool(String ufsPath,
UnderFileSystemConfiguration ufsConf)
The constructor.
|
Modifier and Type | Method and Description |
---|---|
static UnderFileSystemConfiguration |
UfsJournal.getJournalUfsConf() |
Modifier and Type | Field and Description |
---|---|
protected UnderFileSystemConfiguration |
BaseUnderFileSystem.mUfsConf
UFS Configuration options.
|
Modifier and Type | Method and Description |
---|---|
UnderFileSystemConfiguration |
UnderFileSystemConfiguration.createMountSpecificConf(Map<String,? extends Object> mountConf)
Creates a new instance from the current configuration and adds in new properties.
|
static UnderFileSystemConfiguration |
UnderFileSystemConfiguration.defaults(AlluxioConfiguration alluxioConf) |
static UnderFileSystemConfiguration |
UnderFileSystemConfiguration.emptyConfig() |
Modifier and Type | Method and Description |
---|---|
void |
MasterUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
void |
AbstractUfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
void |
UfsManager.addMount(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Keeps track of a mount id and maps it to its URI in Alluxio and configuration.
|
void |
MasterUfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder) |
void |
AbstractUfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder) |
void |
UfsManager.addMountWithRecorder(long mountId,
AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf,
Recorder recorder)
Keeps track of a mount id and maps it to its URI in Alluxio and configuration and records
the execution process.
|
UnderFileSystem |
UnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf)
Creates a new client for accessing the given path.
|
static UnderFileSystem |
UnderFileSystem.Factory.create(String path,
UnderFileSystemConfiguration ufsConf)
Creates a client for operations involved with the under file system.
|
static UnderFileSystem |
UnderFileSystem.Factory.createWithRecorder(String path,
UnderFileSystemConfiguration ufsConf,
Recorder recorder)
Creates a client for operations involved with the under file system and record the
execution process.
|
static UnderFileSystemFactory |
UnderFileSystemFactoryRegistry.find(String path,
UnderFileSystemConfiguration ufsConf)
Finds the first Under File System factory that supports the given path.
|
static List<UnderFileSystemFactory> |
UnderFileSystemFactoryRegistry.findAllWithRecorder(String path,
UnderFileSystemConfiguration ufsConf,
Recorder recorder)
Finds all the Under File System factories that support the given path
and record the execution process.
|
protected AbstractUfsManager.Key |
AbstractUfsManager.generateKey(AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf) |
Optional<UnderFileSystem> |
AbstractUfsManager.get(AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Gets an instance for the given UFS URI and configuration, if such exists.
|
UnderFileSystem |
AbstractUfsManager.getOrAdd(AlluxioURI ufsUri,
UnderFileSystemConfiguration ufsConf)
Return a UFS instance if it already exists in the cache, otherwise, creates a new instance and
return it.
|
default boolean |
UnderFileSystemFactory.supportsPath(String path,
UnderFileSystemConfiguration conf)
Gets whether this factory supports the given path and thus whether calling the
UnderFileSystemFactory.create(String, UnderFileSystemConfiguration) can succeed for
this path. |
Constructor and Description |
---|
BaseUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
BaseUnderFileSystem . |
ConsistentUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Creates a new
ConsistentUnderFileSystem for the given uri. |
ObjectUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs an
ObjectUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AbfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static AbfsUnderFileSystem |
AbfsUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Creates a new
AbfsUnderFileSystem instance. |
Constructor and Description |
---|
AbfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new HDFS
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
AdlUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static org.apache.hadoop.conf.Configuration |
AdlUnderFileSystem.createConfiguration(UnderFileSystemConfiguration conf)
Prepares the configuration for this Adl as an HDFS configuration.
|
static AdlUnderFileSystem |
AdlUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Adl
UnderFileSystem . |
Constructor and Description |
---|
AdlUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration adlConf)
Constructs a new Adl
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CephFSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static CephFSUnderFileSystem |
CephFSUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new CephFS
UnderFileSystem instance. |
Constructor and Description |
---|
CephFSUnderFileSystem(AlluxioURI ufsUri,
com.ceph.fs.CephMount mount,
UnderFileSystemConfiguration conf)
Constructs a new CephFS
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CephfsHadoopUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static CephfsHadoopUnderFileSystem |
CephfsHadoopUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new cephfs-hadoop
UnderFileSystem instance. |
boolean |
CephfsHadoopUnderFileSystemFactory.supportsPath(String path,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
CephfsHadoopUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new Cephfs-Hadoop
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
COSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static COSUnderFileSystem |
COSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
COSUnderFileSystem . |
Constructor and Description |
---|
COSUnderFileSystem(AlluxioURI uri,
com.qcloud.cos.COSClient client,
String bucketName,
String appId,
UnderFileSystemConfiguration conf)
Constructor for
COSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
CosNUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static CosnUnderFileSystem |
CosnUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new Cosn
UnderFileSystem instance. |
boolean |
CosNUnderFileSystemFactory.supportsPath(String path,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
CosnUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new COSN
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
GCSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static GCSUnderFileSystem |
GCSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
GCSUnderFileSystem . |
Constructor and Description |
---|
GCSUnderFileSystem(AlluxioURI uri,
org.jets3t.service.impl.rest.httpclient.GoogleStorageService googleStorageService,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
GCSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static GCSV2UnderFileSystem |
GCSV2UnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
GCSV2UnderFileSystem . |
Constructor and Description |
---|
GCSV2UnderFileSystem(AlluxioURI uri,
com.google.cloud.storage.Storage storageClient,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
GCSV2UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
HdfsUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static org.apache.hadoop.conf.Configuration |
HdfsUnderFileSystem.createConfiguration(UnderFileSystemConfiguration conf)
Prepares the Hadoop configuration necessary to successfully obtain a
FileSystem
instance that can access the provided path. |
static HdfsUnderFileSystem |
HdfsUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new HDFS
UnderFileSystem instance. |
boolean |
HdfsUnderFileSystemFactory.supportsPath(String path,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
HdfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new HDFS
UnderFileSystem . |
HdfsUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf,
boolean useLoadingCache) |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
LocalUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
LocalUnderFileSystem(AlluxioURI uri,
UnderFileSystemConfiguration ufsConf)
Constructs a new
LocalUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OBSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static OBSUnderFileSystem |
OBSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
OBSUnderFileSystem . |
Constructor and Description |
---|
OBSUnderFileSystem(AlluxioURI uri,
com.obs.services.ObsClient obsClient,
String bucketName,
String bucketType,
UnderFileSystemConfiguration conf)
Constructor for
OBSUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OSSUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static OSSUnderFileSystem |
OSSUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
OSSUnderFileSystem . |
protected void |
StsOssClientProvider.createOrRefreshOssStsClient(UnderFileSystemConfiguration ossConfiguration)
Create Or Refresh the STS OSS client.
|
Constructor and Description |
---|
OSSUnderFileSystem(AlluxioURI uri,
com.aliyun.oss.OSS ossClient,
String bucketName,
UnderFileSystemConfiguration conf)
Constructor for
OSSUnderFileSystem . |
StsOssClientProvider(UnderFileSystemConfiguration ossConfiguration)
Constructs a new instance of
StsOssClientProvider . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
OzoneUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static OzoneUnderFileSystem |
OzoneUnderFileSystem.createInstance(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf)
Factory method to constructs a new Ozone
UnderFileSystem instance. |
boolean |
OzoneUnderFileSystemFactory.supportsPath(String path,
UnderFileSystemConfiguration conf) |
Constructor and Description |
---|
OzoneUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration hdfsConf)
Constructs a new Ozone
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
S3AUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static com.amazonaws.services.s3.AmazonS3 |
S3AUnderFileSystem.createAmazonS3(com.amazonaws.auth.AWSCredentialsProvider credentialsProvider,
com.amazonaws.ClientConfiguration clientConf,
com.amazonaws.client.builder.AwsClientBuilder.EndpointConfiguration endpointConfiguration,
UnderFileSystemConfiguration conf)
Create an AmazonS3 client.
|
static software.amazon.awssdk.services.s3.S3AsyncClient |
S3AUnderFileSystem.createAmazonS3Async(UnderFileSystemConfiguration conf,
com.amazonaws.ClientConfiguration clientConf)
Create an async S3 client.
|
static com.amazonaws.auth.AWSCredentialsProvider |
S3AUnderFileSystem.createAwsCredentialsProvider(UnderFileSystemConfiguration conf) |
protected static com.amazonaws.client.builder.AwsClientBuilder.EndpointConfiguration |
S3AUnderFileSystem.createEndpointConfiguration(UnderFileSystemConfiguration conf,
com.amazonaws.ClientConfiguration clientConf)
Creates an endpoint configuration.
|
static S3AUnderFileSystem |
S3AUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Constructs a new instance of
S3AUnderFileSystem . |
Constructor and Description |
---|
S3AUnderFileSystem(AlluxioURI uri,
com.amazonaws.services.s3.AmazonS3 amazonS3Client,
software.amazon.awssdk.services.s3.S3AsyncClient asyncClient,
String bucketName,
ExecutorService executor,
com.amazonaws.services.s3.transfer.TransferManager transferManager,
UnderFileSystemConfiguration conf,
boolean streamingUploadEnabled,
boolean multipartUploadEnabled)
Constructor for
S3AUnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
UnderFileSystem |
WasbUnderFileSystemFactory.create(String path,
UnderFileSystemConfiguration conf) |
static org.apache.hadoop.conf.Configuration |
WasbUnderFileSystem.createConfiguration(UnderFileSystemConfiguration conf,
Boolean isSecure)
Prepares the configuration for this Wasb as an HDFS configuration.
|
static WasbUnderFileSystem |
WasbUnderFileSystem.createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Wasb
UnderFileSystem . |
Constructor and Description |
---|
WasbUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration wasbConf)
Constructs a new Wasb
UnderFileSystem . |
Copyright © 2023. All Rights Reserved.