alluxio.master.job

Class JobTracker

java.lang.Object

alluxio.master.job.JobTracker

@ThreadSafe
public class JobTracker
extends Object

The JobTracker is used to create, remove, and provide access to the set of currently scheduled or finished jobs. All modification of the status of jobs should occur within this class,

Constructor Summary

Constructors

Constructor and Description
JobTracker(long capacity, long retentionMs, long maxJobPurgeCount) Create a new instance of JobTracker.

Method Summary

Modifier and Type	Method and Description
long	addJob(JobConfig jobConfig, CommandManager manager, JobServerContext ctx, List<WorkerInfo> workers) Adds a job with the given JobConfig to the job tracker.
Collection<JobCoordinator>	coordinators() A collection of all JobCoordinator currently tracked by the job master.
JobCoordinator	getCoordinator(long jobId) Gets a JobCoordinator associated with the given job Id.
Collection<Long>	jobs() A collection of all job Ids currently tracked in the job master.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JobTracker

public JobTracker(long capacity,
                  long retentionMs,
                  long maxJobPurgeCount)

Create a new instance of JobTracker.

Parameters:

capacity - the capacity of jobs that can be handled

retentionMs - the minimum amount of time to retain jobs

maxJobPurgeCount - the max amount of jobs to purge when reaching max capacity

Method Detail

getCoordinator

@Nullable
public JobCoordinator getCoordinator(long jobId)

Gets a JobCoordinator associated with the given job Id.

Parameters:

jobId - the job id associated with the JobCoordinator

Returns:

The JobCoordinator associated with the id, or null if there is no association

addJob

public long addJob(JobConfig jobConfig,
                   CommandManager manager,
                   JobServerContext ctx,
                   List<WorkerInfo> workers)
            throws JobDoesNotExistException,
                   ResourceExhaustedException

Adds a job with the given JobConfig to the job tracker.

Parameters:

jobConfig - configuration for the job

manager - command manager for jobs

ctx - the JobServerContext from the job master

workers - a list of available workers

Returns:

the job id of the newly added job

Throws:

JobDoesNotExistException - if the job type does not exist

ResourceExhaustedException - if there is no more space available in the job master

jobs

public Collection<Long> jobs()

A collection of all job Ids currently tracked in the job master. Jobs may be in a finished state.

Returns:

An unmodifiable collection of all tracked Job Ids

coordinators

public Collection<JobCoordinator> coordinators()

A collection of all JobCoordinator currently tracked by the job master. May contain coordinators for jobs which have finished.

Returns:

An unmodifiable collection of all tracked JobCoordinator