alluxio.job.load

Class LoadDefinition

java.lang.Object

alluxio.job.AbstractVoidJobDefinition<LoadConfig,ArrayList<LoadDefinition.LoadTask>>

alluxio.job.load.LoadDefinition

All Implemented Interfaces:

JobDefinition<LoadConfig,ArrayList<LoadDefinition.LoadTask>,SerializableVoid>

@NotThreadSafe
public final class LoadDefinition
extends AbstractVoidJobDefinition<LoadConfig,ArrayList<LoadDefinition.LoadTask>>

A simple loading job that loads the blocks of a file in a distributed and round-robin fashion.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LoadDefinition.LoadTask A task representing loading a block into the memory of a worker.

Constructor Summary

Constructors

Constructor and Description
LoadDefinition() Constructs a new LoadDefinition.

Method Summary

Modifier and Type	Method and Description
Class<LoadConfig>	getJobConfigClass()
SerializableVoid	runTask(LoadConfig config, ArrayList<LoadDefinition.LoadTask> tasks, RunTaskContext context) Runs the task in the executor.
Map<WorkerInfo,ArrayList<LoadDefinition.LoadTask>>	selectExecutors(LoadConfig config, List<WorkerInfo> jobWorkerInfoList, SelectExecutorsContext context) Selects the workers to run the task.

Methods inherited from class alluxio.job.AbstractVoidJobDefinition

join

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LoadDefinition

public LoadDefinition()

Constructs a new LoadDefinition.

Method Detail

selectExecutors

public Map<WorkerInfo,ArrayList<LoadDefinition.LoadTask>> selectExecutors(LoadConfig config,
                                                                          List<WorkerInfo> jobWorkerInfoList,
                                                                          SelectExecutorsContext context)
                                                                   throws Exception

Description copied from interface: JobDefinition

Selects the workers to run the task.

Parameters:

config - the job configuration

jobWorkerInfoList - the list of available workers' information

context - the context containing information used to select executors

Returns:

a map of selected workers to the parameters to pass along

Throws:

Exception - if any error occurs

runTask

public SerializableVoid runTask(LoadConfig config,
                                ArrayList<LoadDefinition.LoadTask> tasks,
                                RunTaskContext context)
                         throws Exception

Description copied from interface: JobDefinition

Runs the task in the executor.

Parameters:

config - the job configuration

tasks - the arguments passed in

context - the context containing information used to execute a task

Returns:

the task result

Throws:

Exception - if any error occurs

getJobConfigClass

public Class<LoadConfig> getJobConfigClass()

Returns:

the class of the associated JobConfig