alluxio.worker.job.task

Class TaskExecutorManager

java.lang.Object

alluxio.worker.job.task.TaskExecutorManager

@ThreadSafe
public class TaskExecutorManager
extends Object

Manages the task executors.

Constructor Summary

Constructors

Constructor and Description
TaskExecutorManager(int taskExecutorPoolSize, WorkerNetAddress address) Constructs a new instance of TaskExecutorManager.

Method Summary

Modifier and Type	Method and Description
void	cancelTask(long jobId, long taskId) Cancels the given task.
void	executeTask(long jobId, long taskId, RunTaskCommand runTaskCommand, RunTaskContext context) Executes the given task.
List<TaskInfo>	getAndClearTaskUpdates()
int	getNumActiveTasks()
int	getTaskExecutorPoolSize()
void	notifyTaskCompletion(long jobId, long taskId, Serializable result) Notifies the completion of the task.
void	notifyTaskFailure(long jobId, long taskId, Throwable t) Notifies the failure of the task.
void	notifyTaskRunning(long jobId, long taskId) Noitfy the start of the task.
void	restoreTaskUpdates(List<TaskInfo> tasks) Adds the given tasks to the task updates data structure.
void	setDefaultTaskExecutorPoolSize(int defaultTaskExecutorPoolSize) Sets the number of threads in the task executor pool when not throttled.
void	throttle() Throttle the TaskExecutorManager.
int	unfinishedTasks()
void	unthrottle() Unthrottle the TaskExecutorManager.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TaskExecutorManager

public TaskExecutorManager(int taskExecutorPoolSize,
                           WorkerNetAddress address)

Constructs a new instance of TaskExecutorManager.

Parameters:

taskExecutorPoolSize - number of task executors in the pool

address - the worker address

Method Detail

getNumActiveTasks

public int getNumActiveTasks()

Returns:

number of active tasks

getTaskExecutorPoolSize

public int getTaskExecutorPoolSize()

Returns:

task executor pool size

setDefaultTaskExecutorPoolSize

public void setDefaultTaskExecutorPoolSize(int defaultTaskExecutorPoolSize)

Sets the number of threads in the task executor pool when not throttled.

Parameters:

defaultTaskExecutorPoolSize - number of threads in the task executor pool

throttle

public void throttle()

Throttle the TaskExecutorManager. This sets the internal thread pool size to 0 until unthrottled.

unthrottle

public void unthrottle()

Unthrottle the TaskExecutorManager. This sets the internal thread pool size back to the default thread pool size.

unfinishedTasks

public int unfinishedTasks()

Returns:

number of unfinished tasks

notifyTaskRunning

public void notifyTaskRunning(long jobId,
                              long taskId)

Noitfy the start of the task.

Parameters:

jobId - the job id

taskId - the task id

notifyTaskCompletion

public void notifyTaskCompletion(long jobId,
                                 long taskId,
                                 Serializable result)

Notifies the completion of the task.

Parameters:

jobId - the job id

taskId - the task id

result - the task execution result

notifyTaskFailure

public void notifyTaskFailure(long jobId,
                              long taskId,
                              Throwable t)

Notifies the failure of the task.

Parameters:

jobId - the job id

taskId - the task id

t - the thrown exception

executeTask

public void executeTask(long jobId,
                        long taskId,
                        RunTaskCommand runTaskCommand,
                        RunTaskContext context)

Executes the given task.

Parameters:

jobId - the job id

taskId - the task id

runTaskCommand - the run task command

context - the context of the worker

cancelTask

public void cancelTask(long jobId,
                       long taskId)

Cancels the given task.

Parameters:

jobId - the job id

taskId - the task id

getAndClearTaskUpdates

public List<TaskInfo> getAndClearTaskUpdates()

Returns:

the list of task information

restoreTaskUpdates

public void restoreTaskUpdates(List<TaskInfo> tasks)

Adds the given tasks to the task updates data structure. If there is already an update for the specified task, it is not changed.

Parameters:

tasks - the tasks to restore