alluxio.cli.fs.command

Class DistributedLoadUtils

java.lang.Object

alluxio.cli.fs.command.DistributedLoadUtils

public final class DistributedLoadUtils
extends Object

Utilities Loads a file or directory in Alluxio space, makes it resident in memory.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DistributedLoadUtils.LoadJobAttemptFactory Factory class for creating different load job attempt.

Method Summary

Modifier and Type	Method and Description
static void	distributedLoad(AbstractDistributedJobCommand command, List<URIStatus> pool, int batchSize, AlluxioURI filePath, int replication, Set<String> workerSet, Set<String> excludedWorkerSet, Set<String> localityIds, Set<String> excludedLocalityIds, boolean printOut) Distributed loads a file or directory in Alluxio space, makes it resident in memory.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

distributedLoad

public static void distributedLoad(AbstractDistributedJobCommand command,
                                   List<URIStatus> pool,
                                   int batchSize,
                                   AlluxioURI filePath,
                                   int replication,
                                   Set<String> workerSet,
                                   Set<String> excludedWorkerSet,
                                   Set<String> localityIds,
                                   Set<String> excludedLocalityIds,
                                   boolean printOut)
                            throws AlluxioException,
                                   IOException

Distributed loads a file or directory in Alluxio space, makes it resident in memory.

Parameters:

command - The command to execute loading

pool - The pool for batched jobs

batchSize - size for batched jobs

filePath - The AlluxioURI path to load into Alluxio memory

replication - Number of block replicas of each loaded file

workerSet - A set of worker hosts to load data

excludedWorkerSet - A set of worker hosts can not to load data

localityIds - The locality identify set

excludedLocalityIds - A set of worker locality identify can not to load data

printOut - whether print out progress in console

Throws:

AlluxioException

IOException