@ThreadSafe public class RocksBlockMetaStore extends Object implements BlockMetaStore, RocksCheckpointed
BlockMetaStore.Block, BlockMetaStore.Factory
Constructor and Description |
---|
RocksBlockMetaStore(String baseDir)
Creates and initializes a rocks block store.
|
Modifier and Type | Method and Description |
---|---|
void |
addLocation(long id,
Block.BlockLocation location)
Adds a new block location.
|
void |
clear()
Removes all metadata from the block store.
|
void |
close()
Closes the block store and releases all resources.
|
Optional<Block.BlockMeta> |
getBlock(long id) |
CheckpointName |
getCheckpointName() |
CloseableIterator<BlockMetaStore.Block> |
getCloseableIterator()
Gets a
CloseableIterator over the blocks. |
List<Block.BlockLocation> |
getLocations(long id)
Gets locations for a block.
|
RocksStore |
getRocksStore() |
void |
putBlock(long id,
Block.BlockMeta meta)
Adds block metadata to the block store.
|
void |
removeBlock(long id)
Removes a block, or does nothing if the block does not exist.
|
void |
removeLocation(long blockId,
long workerId)
Removes a block location.
|
long |
size() |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
restoreFromCheckpoint, restoreFromCheckpoint, writeToCheckpoint, writeToCheckpoint
public RocksBlockMetaStore(String baseDir)
baseDir
- the base directory in which to store block store metadatapublic Optional<Block.BlockMeta> getBlock(long id)
getBlock
in interface BlockMetaStore
id
- a block idpublic void putBlock(long id, Block.BlockMeta meta)
BlockMetaStore
putBlock
in interface BlockMetaStore
id
- the block idmeta
- the block metadatapublic void removeBlock(long id)
BlockMetaStore
removeBlock
in interface BlockMetaStore
id
- a block id to removepublic void clear()
BlockMetaStore
clear
in interface BlockMetaStore
public long size()
size
in interface BlockMetaStore
public void close()
BlockMetaStore
close
in interface BlockMetaStore
public List<Block.BlockLocation> getLocations(long id)
BlockMetaStore
getLocations
in interface BlockMetaStore
id
- a block idpublic void addLocation(long id, Block.BlockLocation location)
BlockMetaStore
addLocation
in interface BlockMetaStore
id
- a block idlocation
- a block locationpublic void removeLocation(long blockId, long workerId)
BlockMetaStore
removeLocation
in interface BlockMetaStore
blockId
- a block idworkerId
- a worker idpublic CloseableIterator<BlockMetaStore.Block> getCloseableIterator()
BlockMetaStore
CloseableIterator
over the blocks.
The iterator must be closed properly.
One option is to follow the below idiom:
try (CloseableIterator<Block> iter =
mBlockStore.getCloseableIterator()) {
while (iter.hasNext()) {
// take the element and perform operations
}
}
If the iterator must be passed to other methods,
it must be closed at the end of operation or on exceptions.
Otherwise there can be a leak!getCloseableIterator
in interface BlockMetaStore
CloseableIterator
over the blockspublic RocksStore getRocksStore()
getRocksStore
in interface RocksCheckpointed
RocksStore
that will produce a checkpointpublic CheckpointName getCheckpointName()
getCheckpointName
in interface Checkpointed
Copyright © 2023. All Rights Reserved.