alluxio.master.job.plan

Class PlanTracker

java.lang.Object

alluxio.master.job.plan.PlanTracker

@ThreadSafe
public class PlanTracker
extends Object

The PlanTracker is used to create, remove, and provide access to the set of currently scheduled or finished jobs. All modification of the status of jobs should occur within this class,

Constructor Summary

Constructors

Constructor and Description
PlanTracker(long capacity, long retentionMs, long maxJobPurgeCount, WorkflowTracker workflowTracker) Create a new instance of PlanTracker.

Method Summary

Modifier and Type	Method and Description
Collection<PlanCoordinator>	coordinators() A collection of all PlanCoordinator currently tracked by the job master.
java.util.stream.Stream<PlanInfo>	failed()
PlanCoordinator	getCoordinator(long jobId) Gets a PlanCoordinator associated with the given job Id.
Collection<Long>	list() A collection of all job Ids currently tracked in the job master.
void	run(PlanConfig jobConfig, CommandManager manager, JobServerContext ctx, List<WorkerInfo> workers, long jobId) Adds a job with the given JobConfig to the job tracker.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PlanTracker

public PlanTracker(long capacity,
                   long retentionMs,
                   long maxJobPurgeCount,
                   WorkflowTracker workflowTracker)

Create a new instance of PlanTracker.

Parameters:

capacity - the capacity of jobs that can be handled

retentionMs - the minimum amount of time to retain jobs

maxJobPurgeCount - the max amount of jobs to purge when reaching max capacity

workflowTracker - the workflow tracker instance

Method Detail

getCoordinator

@Nullable
public PlanCoordinator getCoordinator(long jobId)

Gets a PlanCoordinator associated with the given job Id.

Parameters:

jobId - the job id associated with the PlanCoordinator

Returns:

The PlanCoordinator associated with the id, or null if there is no association

run

public void run(PlanConfig jobConfig,
                CommandManager manager,
                JobServerContext ctx,
                List<WorkerInfo> workers,
                long jobId)
         throws JobDoesNotExistException,
                ResourceExhaustedException

Adds a job with the given JobConfig to the job tracker.

Parameters:

jobConfig - configuration for the job

manager - command manager for jobs

ctx - the JobServerContext from the job master

workers - a list of available workers

jobId - job id of the newly added job

Throws:

JobDoesNotExistException - if the job type does not exist

ResourceExhaustedException - if there is no more space available in the job master

list

public Collection<Long> list()

A collection of all job Ids currently tracked in the job master. Jobs may be in a finished state.

Returns:

An unmodifiable collection of all tracked Job Ids

coordinators

public Collection<PlanCoordinator> coordinators()

A collection of all PlanCoordinator currently tracked by the job master. May contain coordinators for jobs which have finished.

Returns:

An unmodifiable collection of all tracked PlanCoordinator

failed

public java.util.stream.Stream<PlanInfo> failed()

Returns:

list of failed plans