alluxio.job.transform

Class CompactDefinition

java.lang.Object

alluxio.job.AbstractVoidJobDefinition<CompactConfig,ArrayList<CompactTask>>

alluxio.job.transform.CompactDefinition

All Implemented Interfaces:

JobDefinition<CompactConfig,ArrayList<CompactTask>,SerializableVoid>

public final class CompactDefinition
extends AbstractVoidJobDefinition<CompactConfig,ArrayList<CompactTask>>

The job definition for compacting files representing a structured table under a directory.

Constructor Summary

Constructors

Constructor and Description
CompactDefinition() Constructs a new CompactDefinition.

Method Summary

Modifier and Type	Method and Description
Class<CompactConfig>	getJobConfigClass()
SerializableVoid	runTask(CompactConfig config, ArrayList<CompactTask> tasks, RunTaskContext context) Runs the task in the executor.
Map<WorkerInfo,ArrayList<CompactTask>>	selectExecutors(CompactConfig config, List<WorkerInfo> jobWorkers, SelectExecutorsContext context) Selects the workers to run the task.

Methods inherited from class alluxio.job.AbstractVoidJobDefinition

join

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CompactDefinition

public CompactDefinition()

Constructs a new CompactDefinition.

Method Detail

getJobConfigClass

public Class<CompactConfig> getJobConfigClass()

Returns:

the class of the associated JobConfig

selectExecutors

public Map<WorkerInfo,ArrayList<CompactTask>> selectExecutors(CompactConfig config,
                                                              List<WorkerInfo> jobWorkers,
                                                              SelectExecutorsContext context)
                                                       throws Exception

Description copied from interface: JobDefinition

Selects the workers to run the task.

Parameters:

config - the job configuration

jobWorkers - the list of available workers' information

context - the context containing information used to select executors

Returns:

a map of selected workers to the parameters to pass along

Throws:

Exception - if any error occurs

runTask

public SerializableVoid runTask(CompactConfig config,
                                ArrayList<CompactTask> tasks,
                                RunTaskContext context)
                         throws Exception

Description copied from interface: JobDefinition

Runs the task in the executor.

Parameters:

config - the job configuration

tasks - the arguments passed in

context - the context containing information used to execute a task

Returns:

the task result

Throws:

Exception - if any error occurs