alluxio.job.util

Class JobUtils

java.lang.Object

alluxio.job.util.JobUtils

public final class JobUtils
extends Object

Utility class to make it easier to write jobs.

Method Summary

Modifier and Type	Method and Description
static BlockWorkerInfo	getWorkerWithMostBlocks(List<BlockWorkerInfo> workers, List<FileBlockInfo> fileBlockInfos) Returns whichever specified worker stores the most blocks from the block info list.
static void	loadBlock(URIStatus status, FileSystemContext context, long blockId, WorkerNetAddress address, boolean directCache) Loads a block into the local worker.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getWorkerWithMostBlocks

public static BlockWorkerInfo getWorkerWithMostBlocks(List<BlockWorkerInfo> workers,
                                                      List<FileBlockInfo> fileBlockInfos)

Returns whichever specified worker stores the most blocks from the block info list.

Parameters:

workers - a list of workers to consider

fileBlockInfos - a list of file block information

Returns:

a worker address storing the most blocks from the list

loadBlock

public static void loadBlock(URIStatus status,
                             FileSystemContext context,
                             long blockId,
                             WorkerNetAddress address,
                             boolean directCache)
                      throws AlluxioException,
                             IOException

Loads a block into the local worker. If the block doesn't exist in Alluxio, it will be read from the UFS.

Parameters:

status - the uriStatus

context - filesystem context

blockId - the id of the block to load

address - specify a worker to load into

directCache - Use passive-cache or direct cache request

Throws:

AlluxioException

IOException