alluxio.job.util

Class JobUtils

java.lang.Object

alluxio.job.util.JobUtils

public final class JobUtils
extends Object

Utility class to make it easier to write jobs.

Method Summary

Modifier and Type	Method and Description
static BlockWorkerInfo	getWorkerWithMostBlocks(List<BlockWorkerInfo> workers, List<FileBlockInfo> fileBlockInfos) Returns whichever specified worker stores the most blocks from the block info list.
static void	loadBlock(FileSystem fs, FileSystemContext context, String path, long blockId) Loads a block into the local worker.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getWorkerWithMostBlocks

public static BlockWorkerInfo getWorkerWithMostBlocks(List<BlockWorkerInfo> workers,
                                                      List<FileBlockInfo> fileBlockInfos)

Returns whichever specified worker stores the most blocks from the block info list.

Parameters:

workers - a list of workers to consider

fileBlockInfos - a list of file block information

Returns:

a worker address storing the most blocks from the list

loadBlock

public static void loadBlock(FileSystem fs,
                             FileSystemContext context,
                             String path,
                             long blockId)
                      throws AlluxioException,
                             IOException

Loads a block into the local worker. If the block doesn't exist in Alluxio, it will be read from the UFS.

Parameters:

fs - the filesystem

context - filesystem context

path - the file path of the block to load

blockId - the id of the block to load

Throws:

AlluxioException

IOException