alluxio.stress

Class CachingBlockMasterClient

java.lang.Object

alluxio.AbstractClient

alluxio.AbstractMasterClient

alluxio.worker.block.BlockMasterClient

alluxio.stress.CachingBlockMasterClient

All Implemented Interfaces:

Client, Closeable, AutoCloseable

public class CachingBlockMasterClient
extends BlockMasterClient

Use this class to avoid the map-list conversion at the client side. This reduces the client side work so the time measurement for the whole RPC better reflects the time taken at the master side. Also reducing the workload on the client side will avoid the test becoming CPU-bound on the client side, when the concurrency is high.

Nested Class Summary

Nested classes/interfaces inherited from class alluxio.AbstractClient

AbstractClient.RpcCallable<V>

Field Summary

Fields inherited from class alluxio.AbstractClient

mAddress, mChannel, mClosed, mConnected, mContext, mServiceVersion, mVersionService

Constructor Summary

Constructors

Constructor and Description
CachingBlockMasterClient(MasterClientContext conf, List<LocationBlockIdListEntry> locationBlockIdList) Creates a new instance and caches the converted proto.

Method Summary

Modifier and Type	Method and Description
List<LocationBlockIdListEntry>	convertBlockListMapToProto(Map<BlockStoreLocation,List<Long>> blockListOnLocation) Converts the block list map to a proto list.

Methods inherited from class alluxio.worker.block.BlockMasterClient

afterConnect, commitBlock, commitBlockInUfs, getId, getRemoteServiceType, getServiceName, getServiceVersion, heartbeat, register

Methods inherited from class alluxio.AbstractMasterClient

getAddress, getConfAddress

Methods inherited from class alluxio.AbstractClient

afterDisconnect, beforeConnect, beforeDisconnect, checkVersion, close, connect, disconnect, getRemoteServiceVersion, isClosed, isConnected, retryRPC, retryRPC

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CachingBlockMasterClient

public CachingBlockMasterClient(MasterClientContext conf,
                                List<LocationBlockIdListEntry> locationBlockIdList)

Creates a new instance and caches the converted proto.

Parameters:

conf - master client configuration

locationBlockIdList - location block id list

Method Detail

convertBlockListMapToProto

public List<LocationBlockIdListEntry> convertBlockListMapToProto(Map<BlockStoreLocation,List<Long>> blockListOnLocation)

Description copied from class: BlockMasterClient

Converts the block list map to a proto list. Because the list is flattened from a map, in the list no two LocationBlockIdListEntry instances shall have the same BlockStoreLocationProto. The uniqueness of BlockStoreLocationProto is determined by tier alias and medium type. That means directories with the same tier alias and medium type will be merged into the same LocationBlockIdListEntry.

Overrides:

convertBlockListMapToProto in class BlockMasterClient

Parameters:

blockListOnLocation - a map from block location to the block list

Returns:

a flattened and deduplicated list