Package | Description |
---|---|
alluxio.cli.fsadmin.command | |
alluxio.client.block | |
alluxio.client.block.stream | |
alluxio.client.file | |
alluxio.client.file.dora | |
alluxio.client.file.dora.netty | |
alluxio.grpc | |
alluxio.job | |
alluxio.job.wire | |
alluxio.master | |
alluxio.master.block | |
alluxio.master.block.meta | |
alluxio.master.job | |
alluxio.master.scheduler | |
alluxio.membership | |
alluxio.util | |
alluxio.util.network | |
alluxio.wire | |
alluxio.worker |
Worker process and utils for working with the worker remotely.
|
alluxio.worker.block | |
alluxio.worker.dora | |
alluxio.worker.job | |
alluxio.worker.job.command | |
alluxio.worker.job.task |
Modifier and Type | Method and Description |
---|---|
static List<WorkerNetAddress> |
WorkerAddressUtils.parseWorkerAddresses(String workerAddressesStr,
AlluxioConfiguration alluxioConf)
Parses a string to worker addresses.
|
Modifier and Type | Method and Description |
---|---|
static String |
WorkerAddressUtils.convertAddressToStringWebPort(WorkerNetAddress address)
Converts a worker address to string.
|
Modifier and Type | Method and Description |
---|---|
static String |
WorkerAddressUtils.workerAddressListToString(Collection<WorkerNetAddress> workers)
Convert a list of worker addresses to string.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
BlockWorkerInfo.getNetAddress() |
Constructor and Description |
---|
BlockWorkerInfo(WorkerNetAddress netAddress,
long capacityBytes,
long usedBytes)
Constructs the block worker information.
|
BlockWorkerInfo(WorkerNetAddress netAddress,
long capacityBytes,
long usedBytes,
boolean active)
Constructs the block worker information.
|
Modifier and Type | Method and Description |
---|---|
static DataWriter |
DataWriter.Factory.create(FileSystemContext context,
long blockId,
long blockSize,
WorkerNetAddress address,
OutStreamOptions options) |
static NettyDataWriter |
NettyDataWriter.create(FileSystemContext context,
WorkerNetAddress address,
long id,
long length,
RequestType type,
OutStreamOptions options) |
static GrpcDataWriter |
GrpcDataWriter.create(FileSystemContext context,
WorkerNetAddress address,
long id,
long length,
RequestType type,
OutStreamOptions options) |
static BufferCachingGrpcDataReader |
BufferCachingGrpcDataReader.create(FileSystemContext context,
WorkerNetAddress address,
ReadRequest readRequest)
Creates an instance of
BufferCachingGrpcDataReader for block reads. |
Constructor and Description |
---|
BufferCachingGrpcDataReader(WorkerNetAddress address,
CloseableResource<BlockWorkerClient> client,
long dataTimeoutMs,
ReadRequest readRequest,
GrpcBlockingStream<ReadRequest,ReadResponse> stream)
Creates an instance of
BufferCachingGrpcDataReader . |
Factory(FileSystemContext context,
WorkerNetAddress address,
Protocol.ReadRequest.Builder readRequestBuilder)
Creates an instance of
NettyDataReader.Factory for block reads. |
Factory(FileSystemContext context,
WorkerNetAddress address,
ReadRequest.Builder readRequestBuilder)
Creates an instance of
GrpcDataReader.Factory for block reads. |
Factory(FileSystemContext context,
WorkerNetAddress address,
ReadRequest.Builder readRequestBuilder,
long blockSize)
Creates an instance of
SharedGrpcDataReader.Factory for block reads. |
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
FileSystemContext.getNodeLocalWorker() |
WorkerNetAddress |
DoraCacheFileSystem.getWorkerNetAddress(AlluxioURI path)
Get the worker address which the specified file locates at.
|
Modifier and Type | Method and Description |
---|---|
Map<String,List<WorkerNetAddress>> |
DoraCacheFileSystem.checkFileLocation(AlluxioURI path)
Check the location of the specified path.
|
Map<String,List<WorkerNetAddress>> |
DoraCacheFileSystem.checkFileLocation(AlluxioURI path,
GetStatusPOptions options)
Check the location of the specified path.
|
Modifier and Type | Method and Description |
---|---|
CloseableResource<BlockWorkerClient> |
FileSystemContext.acquireBlockWorkerClient(WorkerNetAddress workerNetAddress)
Acquires a block worker client from the client pools.
|
io.netty.channel.Channel |
FileSystemContext.acquireNettyChannel(WorkerNetAddress workerNetAddress)
Acquires a netty channel from the channel pools.
|
void |
FileSystemContext.releaseNettyChannel(WorkerNetAddress workerNetAddress,
io.netty.channel.Channel channel)
Releases a netty channel to the channel pools.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
DoraCacheClient.getWorkerNetAddress(String path)
Get the worker net address of the specific file path.
|
Modifier and Type | Method and Description |
---|---|
Map<String,List<WorkerNetAddress>> |
DoraCacheClient.checkFileLocation(String path,
GetStatusPOptions options)
Get a map that maps file path to the workers list.
|
Modifier and Type | Method and Description |
---|---|
protected GrpcDataReader.Factory |
DoraCacheClient.createGrpcDataReader(WorkerNetAddress workerNetAddress,
Protocol.OpenUfsBlockOptions ufsOptions) |
protected NettyDataReader |
DoraCacheClient.createNettyDataReader(WorkerNetAddress workerNetAddress,
Protocol.OpenUfsBlockOptions ufsOptions) |
Modifier and Type | Method and Description |
---|---|
static NettyDataWriter |
NettyDataWriter.create(FileSystemContext context,
WorkerNetAddress address,
long length,
RequestType type,
OutStreamOptions options) |
Constructor and Description |
---|
NettyDataReader(FileSystemContext context,
WorkerNetAddress address,
Protocol.ReadRequest.Builder requestBuilder)
Constructor.
|
NettyDataReaderStateMachine(FileSystemContext context,
WorkerNetAddress address,
Protocol.ReadRequest.Builder requestBuilder,
ReadTargetBuffer buffer)
Constructor.
|
NettyDataWriter(FileSystemContext context,
WorkerNetAddress address,
long length,
long packetSize,
RequestType type,
OutStreamOptions options,
io.netty.channel.Channel channel)
Creates an instance of
NettyDataWriter . |
Modifier and Type | Method and Description |
---|---|
static WorkerNetAddress |
GrpcUtils.fromProto(WorkerNetAddress workerNetPAddress)
Converts a proto type to a wire type.
|
Modifier and Type | Method and Description |
---|---|
static WorkerNetAddress |
GrpcUtils.toProto(WorkerNetAddress workerNetAddress)
Converts wire type to proto type.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
MasterWorkerInfo.getWorkerAddress() |
Constructor and Description |
---|
MasterWorkerInfo(long id,
WorkerNetAddress address)
Creates a new instance of
MasterWorkerInfo . |
MasterWorkerInfo(long id,
WorkerNetAddress address,
BuildVersion version)
Creates a new instance of
MasterWorkerInfo . |
Constructor and Description |
---|
TaskInfo(long jobId,
long taskId,
Status status,
WorkerNetAddress workerAddress,
Object args)
Constructs a new TaskInfo from jobId, taskId, Status, workerAddress, and arguments.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
LocalAlluxioCluster.getWorkerAddress() |
Modifier and Type | Method and Description |
---|---|
void |
AbstractLocalAlluxioCluster.restartWorkers(Collection<WorkerNetAddress> addresses)
Restarts workers with the addresses provided, so that the workers can restart with
static addresses to simulate a worker restart in the cluster.
|
Modifier and Type | Method and Description |
---|---|
Set<WorkerNetAddress> |
DefaultBlockMaster.getWorkerAddresses() |
Set<WorkerNetAddress> |
BlockMaster.getWorkerAddresses() |
Modifier and Type | Method and Description |
---|---|
long |
DefaultBlockMaster.getWorkerId(WorkerNetAddress workerNetAddress) |
long |
BlockMaster.getWorkerId(WorkerNetAddress workerNetAddress)
Returns a worker id for the given worker, creating one if the worker is new.
|
boolean |
DefaultBlockMaster.isRejected(WorkerNetAddress address) |
boolean |
BlockMaster.isRejected(WorkerNetAddress address) |
void |
DefaultBlockMaster.notifyWorkerId(long workerId,
WorkerNetAddress workerNetAddress) |
void |
BlockMaster.notifyWorkerId(long workerId,
WorkerNetAddress workerNetAddress)
Notify the worker id to a master.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
MasterWorkerInfo.getWorkerAddress()
StaticWorkerMeta is thread safe so the value can be read without locking. |
Constructor and Description |
---|
MasterWorkerInfo(long id,
WorkerNetAddress address)
Creates a new instance of
MasterWorkerInfo . |
StaticWorkerMeta(long id,
WorkerNetAddress address)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
long |
JobMaster.registerWorker(WorkerNetAddress workerNetAddress,
BuildVersion version)
Returns a worker id for the given worker.
|
Modifier and Type | Method and Description |
---|---|
CloseableResource<BlockWorkerClient> |
MembershipManagerWorkerProvider.getWorkerClient(WorkerNetAddress address) |
CloseableResource<BlockWorkerClient> |
DefaultWorkerProvider.getWorkerClient(WorkerNetAddress address) |
CloseableResource<BlockWorkerClient> |
WorkerProvider.getWorkerClient(WorkerNetAddress address)
Gets a worker client.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
WorkerServiceEntity.getWorkerNetAddress()
Get WorkerNetAddress field.
|
Constructor and Description |
---|
WorkerServiceEntity(WorkerNetAddress addr)
CTOR for WorkerServiceEntity with given WorkerNetAddress.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
CommonUtils.isLocalHost(WorkerNetAddress address,
AlluxioConfiguration conf) |
Modifier and Type | Method and Description |
---|---|
static SocketAddress |
NetworkAddressUtils.getDataPortSocketAddress(WorkerNetAddress netAddress,
AlluxioConfiguration conf)
Extracts dataPort socket address from Alluxio representation of network address.
|
static String |
NetworkAddressUtils.getFqdnHost(WorkerNetAddress addr)
Gets FQDN(Full Qualified Domain Name) from Alluxio representation of network address.
|
static SocketAddress |
NetworkAddressUtils.getRpcPortSocketAddress(WorkerNetAddress netAddress,
AlluxioConfiguration conf)
Extracts rpcPort socket address from Alluxio representation of network address.
|
static boolean |
NettyUtils.isDomainSocketAccessible(WorkerNetAddress workerNetAddress,
AlluxioConfiguration conf) |
static boolean |
NettyUtils.isDomainSocketSupported(WorkerNetAddress workerNetAddress) |
Modifier and Type | Field and Description |
---|---|
static WorkerNetAddress |
WorkerNetAddress.DUMMY |
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
WorkerInfo.getAddress() |
WorkerNetAddress |
BlockLocation.getWorkerAddress() |
WorkerNetAddress |
WorkerNetAddress.setContainerHost(String containerHost) |
WorkerNetAddress |
WorkerNetAddress.setDataPort(int dataPort) |
WorkerNetAddress |
WorkerNetAddress.setDomainSocketPath(String domainSocketPath) |
WorkerNetAddress |
WorkerNetAddress.setHost(String host) |
WorkerNetAddress |
WorkerNetAddress.setNettyDataPort(int nettyDataPort) |
WorkerNetAddress |
WorkerNetAddress.setRpcPort(int rpcPort) |
WorkerNetAddress |
WorkerNetAddress.setSecureRpcPort(int secureRpcPort) |
WorkerNetAddress |
WorkerNetAddress.setWebPort(int webPort) |
Modifier and Type | Method and Description |
---|---|
List<WorkerNetAddress> |
BlockLocationInfo.getLocations() |
Modifier and Type | Method and Description |
---|---|
WorkerInfo |
WorkerInfo.setAddress(WorkerNetAddress address) |
BlockLocation |
BlockLocation.setWorkerAddress(WorkerNetAddress workerAddress) |
Constructor and Description |
---|
BlockLocationInfo(FileBlockInfo blockInfo,
List<WorkerNetAddress> locations) |
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
AlluxioJobWorkerProcess.getAddress() |
WorkerNetAddress |
JobWorkerProcess.getAddress() |
WorkerNetAddress |
AlluxioWorkerProcess.getAddress() |
WorkerNetAddress |
WorkerProcess.getAddress() |
Modifier and Type | Method and Description |
---|---|
static void |
JobWorkerIdRegistry.registerWorker(JobMasterClient jobMasterClient,
WorkerNetAddress workerAddress)
Registers with
JobMaster to get a new job worker id. |
void |
JobWorker.start(WorkerNetAddress address) |
void |
AbstractWorker.start(WorkerNetAddress address) |
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
BlockWorker.getWorkerAddress() |
Modifier and Type | Method and Description |
---|---|
long |
BlockMasterClient.getId(WorkerNetAddress address)
Returns a worker id for a workers net address.
|
void |
BlockMasterClient.notifyWorkerId(long workerId,
WorkerNetAddress address)
Notify all masters about the worker ID.
|
Modifier and Type | Method and Description |
---|---|
WorkerNetAddress |
PagedDoraWorker.getAddress() |
WorkerNetAddress |
DoraWorker.getAddress()
Get the address of the Dora Worker.
|
Modifier and Type | Method and Description |
---|---|
void |
PagedDoraWorker.start(WorkerNetAddress address) |
Modifier and Type | Method and Description |
---|---|
long |
RetryHandlingJobMasterClient.registerWorker(WorkerNetAddress address) |
long |
JobMasterClient.registerWorker(WorkerNetAddress address)
Returns a worker id for a workers net address.
|
Constructor and Description |
---|
CommandHandlingExecutor(JobServerContext jobServerContext,
TaskExecutorManager taskExecutorManager,
JobMasterClient masterClient,
WorkerNetAddress workerNetAddress)
Creates a new instance of
CommandHandlingExecutor . |
JobWorkerHealthReport(oshi.hardware.HardwareAbstractionLayer hardware,
WorkerNetAddress workerNetAddress)
Creates a new instance of
JobWorkerHealthReporter.JobWorkerHealthReport . |
JobWorkerHealthReporter(WorkerNetAddress workerNetAddress)
Creates a new instance of
JobWorkerHealthReporter . |
Constructor and Description |
---|
TaskExecutorManager(int taskExecutorPoolSize,
WorkerNetAddress address)
Constructs a new instance of
TaskExecutorManager . |
Copyright © 2023. All Rights Reserved.