Package | Description |
---|---|
alluxio | |
alluxio.cli.fs.command.job | |
alluxio.client.block | |
alluxio.common | |
alluxio.master | |
alluxio.master.job | |
alluxio.master.job.metrics | |
alluxio.master.job.tracker | |
alluxio.master.journal.raft | |
alluxio.proxy | |
alluxio.retry |
Set of utilities for working with retryable operations.
|
alluxio.underfs | |
alluxio.underfs.cos | |
alluxio.underfs.gcs | |
alluxio.underfs.gcs.v2 | |
alluxio.underfs.obs | |
alluxio.underfs.oss | |
alluxio.underfs.s3a | |
alluxio.worker |
Worker process and utils for working with the worker remotely.
|
alluxio.worker.block | |
alluxio.worker.job |
Modifier and Type | Method and Description |
---|---|
protected <V> V |
AbstractClient.retryRPC(RetryPolicy retryPolicy,
AbstractClient.RpcCallable<V> rpc,
org.slf4j.Logger logger,
String rpcName,
String description,
Object... args) |
Constructor and Description |
---|
AbstractClient(ClientContext context,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Creates a new client base with specified retry policy supplier.
|
AbstractJobMasterClient(MasterClientContext clientConf,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Creates a new master client base.
|
AbstractMasterClient(MasterClientContext clientConf,
MasterSelectionPolicy selectionPolicy,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Creates a new master client without a specific address.
|
AbstractMasterClient(MasterClientContext clientConf,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Creates a new master client without a specific address.
|
Modifier and Type | Field and Description |
---|---|
protected RetryPolicy |
JobAttempt.mRetryPolicy |
Constructor and Description |
---|
JobAttempt(JobMasterClient client,
RetryPolicy retryPolicy) |
Constructor and Description |
---|
RetryHandlingBlockMasterClient(MasterClientContext conf,
InetSocketAddress address,
java.util.function.Supplier<RetryPolicy> retryPolicy)
Creates a new block master client.
|
Modifier and Type | Method and Description |
---|---|
protected java.util.function.Supplier<RetryPolicy> |
RpcPortHealthCheckClient.getRetryPolicySupplier() |
Constructor and Description |
---|
RpcPortHealthCheckClient(InetSocketAddress nodeAddress,
ServiceType serviceType,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier,
AlluxioConfiguration alluxioConf)
Creates a worker health check client.
|
Modifier and Type | Field and Description |
---|---|
static java.util.function.Supplier<RetryPolicy> |
AlluxioMasterMonitor.TWO_MIN_EXP_BACKOFF |
Modifier and Type | Method and Description |
---|---|
MasterHealthCheckClient.Builder |
MasterHealthCheckClient.Builder.withRetryPolicy(java.util.function.Supplier<RetryPolicy> policySupplier) |
Constructor and Description |
---|
JobMasterRpcHealthCheckClient(InetSocketAddress jobMasterAddress,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier,
AlluxioConfiguration alluxioConf)
Creates a job_master health check client.
|
Modifier and Type | Method and Description |
---|---|
static void |
DistributedCmdMetrics.batchIncrementForCompleteStatusWithRetry(BatchedJobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for batch config for complete status.
|
static long |
DistributedCmdMetrics.getFileSize(String filePath,
FileSystem fileSystem,
RetryPolicy retryPolicy)
get file size for a given filePath, return 0 if exceeding retries.
|
static void |
DistributedCmdMetrics.incrementForAllConfigsCompleteStatus(JobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for both batch and non-batch configs for COMPLETE status.
|
static void |
DistributedCmdMetrics.incrementForCompleteStatusWithRetry(JobConfig config,
FileSystem fileSystem,
RetryPolicy retryPolicy)
Increment for non-batch config for complete status.
|
Modifier and Type | Field and Description |
---|---|
protected RetryPolicy |
CmdRunAttempt.mRetryPolicy |
Constructor and Description |
---|
CmdRunAttempt(RetryPolicy retryPolicy,
JobMaster jobMaster) |
Constructor and Description |
---|
RaftJournalServiceClient(MasterSelectionPolicy selectionPolicy,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Create a client that talks to a specific master.
|
Constructor and Description |
---|
ProxyHealthCheckClient(InetSocketAddress proxyAddress,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier)
Creates a proxy health check client.
|
Modifier and Type | Class and Description |
---|---|
class |
CountingRetry
An option which allows retrying based on maximum count.
|
class |
ExponentialBackoffRetry
Each retry will cause a sleep to happen.
|
class |
ExponentialTimeBoundedRetry
A retry policy which uses exponential backoff and a maximum duration time bound.
|
class |
SleepingRetry
A retry policy that uses thread sleeping for the delay.
|
class |
TimeBoundedRetry
Retry mechanism which performs retries until a certain period of time has elapsed.
|
class |
TimeoutRetry
A retry policy which allows retrying until a specified timeout is reached.
|
Modifier and Type | Method and Description |
---|---|
static RetryPolicy |
RetryUtils.defaultClientRetry()
Gives a default ClientRetry based on config.
|
static RetryPolicy |
RetryUtils.defaultWorkerMasterClientRetry() |
Modifier and Type | Method and Description |
---|---|
static void |
RetryUtils.retry(String action,
RetryUtils.RunnableThrowsIOException f,
RetryPolicy policy)
Retries the given method until it doesn't throw an IO exception or the retry policy expires.
|
static <V> V |
RetryUtils.retryCallable(String description,
Callable<V> f,
RetryPolicy policy)
Notice we assume the exception with the method is retryable, so we are not wasting time here.
|
Modifier and Type | Field and Description |
---|---|
protected java.util.function.Supplier<RetryPolicy> |
ObjectMultipartUploadOutputStream.mRetryPolicy
The retry policy of this multipart upload.
|
protected java.util.function.Supplier<RetryPolicy> |
ObjectLowLevelOutputStream.mRetryPolicy
The retry policy of this multipart upload.
|
Modifier and Type | Method and Description |
---|---|
protected abstract InputStream |
ObjectUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy)
Internal function to open an input stream to an object.
|
Modifier and Type | Method and Description |
---|---|
protected InputStream |
COSUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Modifier and Type | Method and Description |
---|---|
protected InputStream |
GCSUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Modifier and Type | Method and Description |
---|---|
protected InputStream |
GCSV2UnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Modifier and Type | Method and Description |
---|---|
protected InputStream |
OBSUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Modifier and Type | Method and Description |
---|---|
protected InputStream |
OSSUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Modifier and Type | Field and Description |
---|---|
protected RetryPolicy |
S3AInputStream.mRetryPolicy
Policy determining the retry behavior in case the key does not exist.
|
Modifier and Type | Method and Description |
---|---|
protected InputStream |
S3AUnderFileSystem.openObject(String key,
OpenOptions options,
RetryPolicy retryPolicy) |
Constructor and Description |
---|
S3AInputStream(String bucketName,
String key,
com.amazonaws.services.s3.AmazonS3 client,
long position,
RetryPolicy retryPolicy)
Constructor for an input stream of an object in s3 using the aws-sdk implementation to read the
data.
|
Modifier and Type | Field and Description |
---|---|
static java.util.function.Supplier<RetryPolicy> |
AlluxioWorkerMonitor.ONE_MIN_EXP_BACKOFF |
Constructor and Description |
---|
WorkerHealthCheckClient(InetSocketAddress workerAddress,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier,
AlluxioConfiguration alluxioConf)
Creates a worker health check client.
|
Modifier and Type | Method and Description |
---|---|
void |
BlockMasterClient.acquireRegisterLeaseWithBackoff(long workerId,
int estimatedBlockCount,
RetryPolicy retry)
Acquires a
RegisterLease from the master with
the RetryPolicy specified. |
Constructor and Description |
---|
JobWorkerHealthCheckClient(InetSocketAddress jobWorkerAddress,
java.util.function.Supplier<RetryPolicy> retryPolicySupplier,
AlluxioConfiguration alluxioConf)
Creates a worker health check client.
|
Copyright © 2023. All Rights Reserved.