public final class DistributedLoadUtils extends Object
|Modifier and Type||Class and Description|
Factory class for creating different load job attempt.
|Modifier and Type||Method and Description|
Distributed loads a file or directory in Alluxio space, makes it resident in memory.
public static void distributedLoad(AbstractDistributedJobCommand command, List<URIStatus> pool, int batchSize, AlluxioURI filePath, int replication, Set<String> workerSet, Set<String> excludedWorkerSet, Set<String> localityIds, Set<String> excludedLocalityIds, boolean directCache, boolean printOut) throws AlluxioException, IOException
command- The command to execute loading
pool- The pool for batched jobs
batchSize- size for batched jobs
AlluxioURIpath to load into Alluxio memory
replication- Number of block replicas of each loaded file
workerSet- A set of worker hosts to load data
excludedWorkerSet- A set of worker hosts can not to load data
localityIds- The locality identify set
excludedLocalityIds- A set of worker locality identify can not to load data
directCache- use direct cache request or cache through read
printOut- whether print out progress in console
Copyright © 2022. All Rights Reserved.