Package | Description |
---|---|
alluxio | |
alluxio.stress | |
alluxio.stress.cli | |
alluxio.worker.block | |
alluxio.worker.block.allocator | |
alluxio.worker.block.annotator | |
alluxio.worker.block.evictor |
Set of evictors for evicting or moving blocks to other locations.
|
alluxio.worker.block.io | |
alluxio.worker.block.management | |
alluxio.worker.block.meta |
Modifier and Type | Method and Description |
---|---|
List<Pair<BlockStoreLocation,BlockStoreLocation>> |
AbstractStorageTierAssoc.intersectionList() |
List<Pair<BlockStoreLocation,BlockStoreLocation>> |
AbstractStorageTierAssoc.intersectionList() |
List<Pair<BlockStoreLocation,BlockStoreLocation>> |
StorageTierAssoc.intersectionList() |
List<Pair<BlockStoreLocation,BlockStoreLocation>> |
StorageTierAssoc.intersectionList() |
Modifier and Type | Method and Description |
---|---|
List<LocationBlockIdListEntry> |
CachingBlockMasterClient.convertBlockListMapToProto(Map<BlockStoreLocation,List<Long>> blockListOnLocation) |
void |
CachingBlockMasterClient.registerWithStream(long workerId,
List<String> storageTierAliases,
Map<String,Long> totalBytesOnTiers,
Map<String,Long> usedBytesOnTiers,
Map<BlockStoreLocation,List<Long>> currentBlocksOnLocation,
Map<String,List<String>> lostStorage,
List<ConfigProperty> configList) |
Constructor and Description |
---|
CachingBlockMapIterator(Map<BlockStoreLocation,List<Long>> blockLocationMap,
AlluxioConfiguration conf)
Constructor.
|
CachingBlockMasterClient(MasterClientContext conf,
Map<BlockStoreLocation,List<Long>> blockMap)
Creates a new instance and caches the converted proto.
|
Modifier and Type | Field and Description |
---|---|
static BlockStoreLocation |
RpcBenchPreparationUtils.BLOCK_LOCATION_MEM |
Modifier and Type | Method and Description |
---|---|
static Map<BlockStoreLocation,List<Long>> |
RpcBenchPreparationUtils.generateBlockIdOnTiers(Map<TierAlias,List<Integer>> tiersConfig)
Generates block IDs according to the storage tier/dir setup.
|
Modifier and Type | Method and Description |
---|---|
static void |
RpcBenchPreparationUtils.prepareBlocksInMaster(Map<BlockStoreLocation,List<Long>> locToBlocks)
Prepare all relevant block IDs on the master side concurrently.
|
Modifier and Type | Method and Description |
---|---|
static BlockStoreLocation |
BlockStoreLocation.anyDirInAnyTierWithMedium(String mediumType)
Convenience method to return the block store location representing any dir in any tier
with specific medium.
|
static BlockStoreLocation |
BlockStoreLocation.anyDirInTier(String tierAlias)
Convenience method to return the block store location representing any dir in the tier.
|
static BlockStoreLocation |
BlockStoreLocation.anyTier()
Convenience method to return the block store location representing any dir in any tier.
|
BlockStoreLocation |
AllocateOptions.getLocation() |
Modifier and Type | Method and Description |
---|---|
Map<BlockStoreLocation,List<Long>> |
BlockHeartbeatReport.getAddedBlocks()
Gets the list of blocks added by the worker in the heartbeat this report represents.
|
Map<BlockStoreLocation,List<Long>> |
DefaultBlockStoreMeta.getBlockListByStorageLocation() |
Map<BlockStoreLocation,List<Long>> |
BlockStoreMeta.getBlockListByStorageLocation()
Note: This method is only available when users initialize
the blockStoreMeta with full block meta requirement.
|
Modifier and Type | Method and Description |
---|---|
boolean |
BlockStoreLocation.belongsTo(BlockStoreLocation location)
Returns whether this location belongs to the specific location.
|
static AllocateOptions |
AllocateOptions.forCreate(long sizeBytes,
BlockStoreLocation location)
Creates default allocation options for block create request.
|
static AllocateOptions |
AllocateOptions.forMove(BlockStoreLocation location)
Creates default allocation options for moving a block by a client request.
|
static AllocateOptions |
AllocateOptions.forRequestSpace(long sizeBytes,
BlockStoreLocation location)
Creates default allocation options for requesting more space for a block.
|
static AllocateOptions |
AllocateOptions.forTierMove(BlockStoreLocation location)
Creates default allocation options for moving a block during tier-move task.
|
void |
TieredBlockStore.freeSpace(long sessionId,
long minContiguousBytes,
long minAvailableBytes,
BlockStoreLocation location)
Free space is the entry for immediate block deletion in order to open up space for
new or ongoing blocks.
|
long |
BlockMetadataEvictorView.getAvailableBytes(BlockStoreLocation location)
Gets available bytes given certain location
BlockMetadataManager.getAvailableBytes(BlockStoreLocation) . |
long |
BlockMetadataManager.getAvailableBytes(BlockStoreLocation location)
Gets the amount of available space of given location in bytes.
|
String |
BlockMetadataManager.getBlockPath(long blockId,
BlockStoreLocation location)
Returns the path of a block given its location, or null if the location is not a specific
StorageDir . |
StorageDir |
BlockMetadataManager.getDir(BlockStoreLocation location)
Gets the
StorageDir given its location in the store. |
List<StorageDirView> |
BlockMetadataEvictorView.getDirs(BlockStoreLocation location)
Gets all dir views that belongs to a given location.
|
void |
TieredBlockStore.moveBlock(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
AllocateOptions moveOptions) |
void |
BlockStore.moveBlock(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
AllocateOptions moveOptions)
Moves an existing block to a new location.
|
BlockMeta |
BlockMetadataManager.moveBlockMeta(BlockMeta blockMeta,
BlockStoreLocation newLocation)
Deprecated.
As of version 0.8. Use
BlockMetadataManager.moveBlockMeta(BlockMeta, TempBlockMeta) instead. |
void |
AbstractBlockStoreEventListener.onAccessBlock(long sessionId,
long blockId,
BlockStoreLocation location) |
void |
BlockStoreEventListener.onAccessBlock(long sessionId,
long blockId,
BlockStoreLocation location)
Actions when accessing a block.
|
void |
AbstractBlockStoreEventListener.onCommitBlock(long sessionId,
long blockId,
BlockStoreLocation location) |
void |
BlockStoreEventListener.onCommitBlock(long sessionId,
long blockId,
BlockStoreLocation location)
Actions when committing a temporary block to a
BlockStoreLocation . |
void |
BlockMetricsReporter.onMoveBlockByClient(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
BlockHeartbeatReporter.onMoveBlockByClient(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
AbstractBlockStoreEventListener.onMoveBlockByClient(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
BlockStoreEventListener.onMoveBlockByClient(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation)
Actions when moving a block by a client from a
BlockStoreLocation to another. |
void |
BlockMetricsReporter.onMoveBlockByWorker(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
BlockHeartbeatReporter.onMoveBlockByWorker(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
AbstractBlockStoreEventListener.onMoveBlockByWorker(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation) |
void |
BlockStoreEventListener.onMoveBlockByWorker(long sessionId,
long blockId,
BlockStoreLocation oldLocation,
BlockStoreLocation newLocation)
Actions when moving a block by a worker from a
BlockStoreLocation to another. |
void |
AbstractBlockStoreEventListener.onRemoveBlock(long sessionId,
long blockId,
BlockStoreLocation location) |
void |
BlockStoreEventListener.onRemoveBlock(long sessionId,
long blockId,
BlockStoreLocation location)
Actions when removing an existing block.
|
void |
AbstractBlockStoreEventListener.onStorageLost(BlockStoreLocation dirLocation) |
void |
BlockStoreEventListener.onStorageLost(BlockStoreLocation dirLocation)
Actions when a storage dir is lost.
|
void |
TieredBlockStore.removeBlock(long sessionId,
long blockId,
BlockStoreLocation location) |
void |
BlockStore.removeBlock(long sessionId,
long blockId,
BlockStoreLocation location)
Removes an existing block.
|
AllocateOptions |
AllocateOptions.setLocation(BlockStoreLocation location)
Sets the allocation location.
|
Modifier and Type | Method and Description |
---|---|
List<LocationBlockIdListEntry> |
BlockMasterClient.convertBlockListMapToProto(Map<BlockStoreLocation,List<Long>> blockListOnLocation)
Converts the block list map to a proto list.
|
Command |
BlockMasterClient.heartbeat(long workerId,
Map<String,Long> capacityBytesOnTiers,
Map<String,Long> usedBytesOnTiers,
List<Long> removedBlocks,
Map<BlockStoreLocation,List<Long>> addedBlocks,
Map<String,List<String>> lostStorage,
List<Metric> metrics)
The method the worker should periodically execute to heartbeat back to the master.
|
void |
BlockMasterClient.register(long workerId,
List<String> storageTierAliases,
Map<String,Long> totalBytesOnTiers,
Map<String,Long> usedBytesOnTiers,
Map<BlockStoreLocation,List<Long>> currentBlocksOnLocation,
Map<String,List<String>> lostStorage,
List<ConfigProperty> configList)
The method the worker should execute to register with the block master.
|
void |
BlockMasterClient.registerWithStream(long workerId,
List<String> storageTierAliases,
Map<String,Long> totalBytesOnTiers,
Map<String,Long> usedBytesOnTiers,
Map<BlockStoreLocation,List<Long>> currentBlocksOnLocation,
Map<String,List<String>> lostStorage,
List<ConfigProperty> configList)
Registers with the master in a stream.
|
Constructor and Description |
---|
BlockHeartbeatReport(Map<BlockStoreLocation,List<Long>> addedBlocks,
List<Long> removedBlocks,
Map<String,List<String>> lostStorage)
Creates a new instance of
BlockHeartbeatReport . |
BlockMapIterator(Map<BlockStoreLocation,List<Long>> blockLocationMap)
Constructor.
|
BlockMapIterator(Map<BlockStoreLocation,List<Long>> blockLocationMap,
AlluxioConfiguration conf)
Constructor.
|
RegisterStreamer(BlockMasterWorkerServiceGrpc.BlockMasterWorkerServiceStub asyncClient,
long workerId,
List<String> storageTierAliases,
Map<String,Long> totalBytesOnTiers,
Map<String,Long> usedBytesOnTiers,
Map<BlockStoreLocation,List<Long>> currentBlocksOnLocation,
Map<String,List<String>> lostStorage,
List<ConfigProperty> configList)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
StorageDirView |
GreedyAllocator.allocateBlockWithView(long sessionId,
long blockSize,
BlockStoreLocation location,
BlockMetadataView metadataView,
boolean skipReview) |
StorageDirView |
MaxFreeAllocator.allocateBlockWithView(long sessionId,
long blockSize,
BlockStoreLocation location,
BlockMetadataView metadataView,
boolean skipReview) |
StorageDirView |
RoundRobinAllocator.allocateBlockWithView(long sessionId,
long blockSize,
BlockStoreLocation location,
BlockMetadataView metadataView,
boolean skipReview) |
StorageDirView |
Allocator.allocateBlockWithView(long sessionId,
long blockSize,
BlockStoreLocation location,
BlockMetadataView view,
boolean skipReview)
Allocates a block from the given block store location under a given view.
|
Modifier and Type | Method and Description |
---|---|
boolean |
EmulatingBlockIterator.aligned(BlockStoreLocation srcLocation,
BlockStoreLocation dstLocation,
BlockOrder order,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
boolean |
DefaultBlockIterator.aligned(BlockStoreLocation srcLocation,
BlockStoreLocation dstLocation,
BlockOrder order,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
boolean |
BlockIterator.aligned(BlockStoreLocation srcLocation,
BlockStoreLocation dstLocation,
BlockOrder order,
java.util.function.Function<Long,Boolean> blockFilterFunc)
Used to detect presence of an overlap between two locations.
|
List<Long> |
EmulatingBlockIterator.getIntersectionList(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int intersectionWidth,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
List<Long> |
DefaultBlockIterator.getIntersectionList(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int intersectionWidth,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
List<Long> |
BlockIterator.getIntersectionList(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int intersectionWidth,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc)
Used to get blocks within an intersection of locations in sorted order.
|
Iterator<Long> |
EmulatingBlockIterator.getIterator(BlockStoreLocation location,
BlockOrder order) |
Iterator<Long> |
DefaultBlockIterator.getIterator(BlockStoreLocation location,
BlockOrder order) |
Iterator<Long> |
BlockIterator.getIterator(BlockStoreLocation location,
BlockOrder order)
Gets an iterator of block-Ids.
|
Pair<List<Long>,List<Long>> |
EmulatingBlockIterator.getSwaps(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int swapRange,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
Pair<List<Long>,List<Long>> |
DefaultBlockIterator.getSwaps(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int swapRange,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc) |
Pair<List<Long>,List<Long>> |
BlockIterator.getSwaps(BlockStoreLocation srcLocation,
BlockOrder srcOrder,
BlockStoreLocation dstLocation,
BlockOrder dstOrder,
int swapRange,
BlockOrder intersectionOrder,
java.util.function.Function<Long,Boolean> blockFilterFunc)
Used to list of blocks, that if swapped, could eliminate overlap between two tiers.
|
Modifier and Type | Method and Description |
---|---|
BlockStoreLocation |
BlockTransferInfo.getDstLocation() |
BlockStoreLocation |
BlockTransferInfo.getSrcLocation() |
protected BlockStoreLocation |
AbstractEvictor.updateBlockStoreLocation(long bytesToBeAvailable,
BlockStoreLocation location)
Deprecated.
Updates the block store location if the evictor wants to free space in a specific location.
|
Modifier and Type | Method and Description |
---|---|
List<Pair<Long,BlockStoreLocation>> |
EvictionPlan.toEvict() |
Modifier and Type | Method and Description |
---|---|
protected StorageDirEvictorView |
AbstractEvictor.cascadingEvict(long bytesToBeAvailable,
BlockStoreLocation location,
EvictionPlan plan,
Evictor.Mode mode)
Deprecated.
A recursive implementation of cascading eviction.
|
static BlockTransferInfo |
BlockTransferInfo.createMove(BlockStoreLocation srcLocation,
long srcBlockId,
BlockStoreLocation dstLocation)
Creates a new instance of
BlockTransferInfo for moving a block. |
static BlockTransferInfo |
BlockTransferInfo.createSwap(BlockStoreLocation srcLocation,
long srcBlockId,
BlockStoreLocation dstLocation,
long dstBlockId)
Creates a new instance of
BlockTransferInfo for swapping two blocks. |
EvictionPlan |
Evictor.freeSpaceWithView(long availableBytes,
BlockStoreLocation location,
BlockMetadataEvictorView view)
Frees space with the guaranteed mode.
|
EvictionPlan |
AbstractEvictor.freeSpaceWithView(long bytesToBeAvailable,
BlockStoreLocation location,
BlockMetadataEvictorView view)
Deprecated.
|
EvictionPlan |
Evictor.freeSpaceWithView(long availableBytes,
BlockStoreLocation location,
BlockMetadataEvictorView view,
Evictor.Mode mode)
Frees space in the given block store location and with the given view.
|
EvictionPlan |
AbstractEvictor.freeSpaceWithView(long bytesToBeAvailable,
BlockStoreLocation location,
BlockMetadataEvictorView view,
Evictor.Mode mode)
Deprecated.
|
static StorageDirView |
EvictorUtils.getDirWithMaxFreeSpace(long bytesToBeAvailable,
BlockStoreLocation location,
BlockMetadataEvictorView metadataView)
Gets
StorageDirView with max free space. |
void |
LRUEvictor.onCommitBlock(long sessionId,
long blockId,
BlockStoreLocation location)
Deprecated.
|
static StorageDirView |
EvictorUtils.selectDirWithRequestedSpace(long bytesToBeAvailable,
BlockStoreLocation location,
BlockMetadataEvictorView mManagerView)
Finds a directory in the given location range with capacity upwards of the given bound.
|
protected BlockStoreLocation |
AbstractEvictor.updateBlockStoreLocation(long bytesToBeAvailable,
BlockStoreLocation location)
Deprecated.
Updates the block store location if the evictor wants to free space in a specific location.
|
Constructor and Description |
---|
EvictionPlan(List<BlockTransferInfo> toTransfer,
List<Pair<Long,BlockStoreLocation>> toEvict)
Creates a new instance of
EvictionPlan . |
Modifier and Type | Method and Description |
---|---|
void |
BlockClientListener.clientClosed(BlockClient blockClient,
BlockStoreLocation location)
Called when an open block client is closed.
|
void |
BlockClientListener.clientOpened(BlockClient blockClient,
BlockStoreLocation location)
Called when a new block client is opened.
|
static void |
BlockStreamTracker.readerClosed(BlockReader reader,
BlockStoreLocation location)
Called when an existing block reader is closed.
|
static void |
BlockStreamTracker.readerOpened(BlockReader reader,
BlockStoreLocation location)
Called with a new block reader.
|
static void |
BlockStreamTracker.writerClosed(BlockWriter writer,
BlockStoreLocation location)
Called when an existing block writer is closed.
|
static void |
BlockStreamTracker.writerOpened(BlockWriter writer,
BlockStoreLocation location)
Called with a new block writer.
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultStoreLoadTracker.clientClosed(BlockClient blockClient,
BlockStoreLocation location) |
void |
DefaultStoreLoadTracker.clientOpened(BlockClient blockClient,
BlockStoreLocation location) |
boolean |
DefaultStoreLoadTracker.loadDetected(BlockStoreLocation... locations) |
boolean |
StoreLoadTracker.loadDetected(BlockStoreLocation... locations)
Used to detect load on particular location.
|
Modifier and Type | Method and Description |
---|---|
BlockStoreLocation |
DefaultBlockMeta.getBlockLocation() |
BlockStoreLocation |
DefaultTempBlockMeta.getBlockLocation() |
BlockStoreLocation |
TempBlockMeta.getBlockLocation() |
BlockStoreLocation |
BlockMeta.getBlockLocation() |
BlockStoreLocation |
DefaultStorageDir.toBlockStoreLocation() |
BlockStoreLocation |
StorageDirView.toBlockStoreLocation()
Creates a
BlockStoreLocation for this directory view. |
BlockStoreLocation |
StorageDir.toBlockStoreLocation() |
Copyright © 2023. All Rights Reserved.