alluxio.job.plan.batch

Class BatchedJobDefinition

java.lang.Object

alluxio.job.plan.AbstractVoidPlanDefinition<BatchedJobConfig,BatchedJobDefinition.BatchedJobTask>

alluxio.job.plan.batch.BatchedJobDefinition

All Implemented Interfaces:

PlanDefinition<BatchedJobConfig,BatchedJobDefinition.BatchedJobTask,SerializableVoid>

@NotThreadSafe
public final class BatchedJobDefinition
extends AbstractVoidPlanDefinition<BatchedJobConfig,BatchedJobDefinition.BatchedJobTask>

A simple loading job that loads the blocks of a file in a distributed and round-robin fashion.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BatchedJobDefinition.BatchedJobTask A task representing loading a block into the memory of a worker.
static class	BatchedJobDefinition.JobDefinitionFactory Factory class for get the specific job definition.

Constructor Summary

Constructors

Constructor and Description
BatchedJobDefinition() Constructs a new BatchedJobDefinition.

Method Summary

Modifier and Type	Method and Description
Class<BatchedJobConfig>	getJobConfigClass()
SerializableVoid	runTask(BatchedJobConfig config, BatchedJobDefinition.BatchedJobTask task, RunTaskContext context) Runs the task in the executor.
Set<Pair<WorkerInfo,BatchedJobDefinition.BatchedJobTask>>	selectExecutors(BatchedJobConfig config, List<WorkerInfo> jobWorkerInfoList, SelectExecutorsContext context) Selects the workers to run the task.

Methods inherited from class alluxio.job.plan.AbstractVoidPlanDefinition

join

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchedJobDefinition

public BatchedJobDefinition()

Constructs a new BatchedJobDefinition.

Method Detail

selectExecutors

public Set<Pair<WorkerInfo,BatchedJobDefinition.BatchedJobTask>> selectExecutors(BatchedJobConfig config,
                                                                                 List<WorkerInfo> jobWorkerInfoList,
                                                                                 SelectExecutorsContext context)
                                                                          throws Exception

Description copied from interface: PlanDefinition

Selects the workers to run the task.

Parameters:

config - the job configuration

jobWorkerInfoList - the list of available workers' information

context - the context containing information used to select executors

Returns:

a set of pairs of selected workers to the parameters to pass along

Throws:

Exception - if any error occurs

runTask

public SerializableVoid runTask(BatchedJobConfig config,
                                BatchedJobDefinition.BatchedJobTask task,
                                RunTaskContext context)
                         throws Exception

Description copied from interface: PlanDefinition

Runs the task in the executor.

Parameters:

config - the job configuration

task - the arguments passed in

context - the context containing information used to execute a task

Returns:

the task result

Throws:

Exception - if any error occurs

getJobConfigClass

public Class<BatchedJobConfig> getJobConfigClass()

Returns:

the class of the associated JobConfig