alluxio.master.job

Class JobMaster

java.lang.Object

alluxio.master.AbstractMaster

alluxio.master.job.JobMaster

All Implemented Interfaces:

Checkpointed, Journaled, JournalEntryIterable, NoopJournaled, Master, Server<Boolean>

@ThreadSafe
public final class JobMaster
extends AbstractMaster
implements NoopJournaled

The master that handles all job managing operations.

Field Summary

Fields inherited from class alluxio.master.AbstractMaster

mClock, mMasterContext

Constructor Summary

Constructors

Constructor and Description
JobMaster(MasterContext masterContext, FileSystem filesystem, FileSystemContext fsContext, UfsManager ufsManager) Creates a new instance of JobMaster.

Method Summary

Modifier and Type	Method and Description
void	cancel(long jobId) Cancels a job.
String	getName()
Map<ServiceType,GrpcService>	getServices()
JobInfo	getStatus(long jobId) Gets information of the given job id.
JobServiceSummary	getSummary() Gets summary of the job service.
List<WorkerInfo>	getWorkerInfoList()
List<Long>	list()
long	registerWorker(WorkerNetAddress workerNetAddress) Returns a worker id for the given worker.
long	run(JobConfig jobConfig) Runs a job with the given configuration.
void	start(Boolean isLeader) Starts the Alluxio server.
List<JobCommand>	workerHeartbeat(long workerId, List<TaskInfo> taskInfoList) Updates the tasks' status when a worker periodically heartbeats with the master, and sends the commands for the worker to execute.

Methods inherited from class alluxio.master.AbstractMaster

close, createJournalContext, getDependencies, getExecutorService, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.master.journal.NoopJournaled

getCheckpointName, getJournalEntryIterator, processJournalEntry, resetState, restoreFromCheckpoint, writeToCheckpoint

Methods inherited from interface alluxio.master.journal.Journaled

applyAndJournal

Constructor Detail

JobMaster

public JobMaster(MasterContext masterContext,
                 FileSystem filesystem,
                 FileSystemContext fsContext,
                 UfsManager ufsManager)

Creates a new instance of JobMaster.

Parameters:

masterContext - the context for Alluxio master

filesystem - the Alluxio filesystem client the job master uses to communicate

fsContext - the filesystem client's underlying context

ufsManager - the ufs manager

Method Detail

start

public void start(Boolean isLeader)
           throws IOException

Description copied from interface: Server

Starts the Alluxio server.

Specified by:

start in interface Server<Boolean>

Overrides:

start in class AbstractMaster

Parameters:

isLeader - the start options

Throws:

IOException

getServices

public Map<ServiceType,GrpcService> getServices()

Specified by:

getServices in interface Server<Boolean>

Returns:

a map from service names to gRPC serviced that serve RPCs for this server

getName

public String getName()

Specified by:

getName in interface Server<Boolean>

Returns:

the server's name

run

public long run(JobConfig jobConfig)
         throws JobDoesNotExistException,
                ResourceExhaustedException

Runs a job with the given configuration.

Parameters:

jobConfig - the job configuration

Returns:

the job id tracking the progress

Throws:

JobDoesNotExistException - when the job doesn't exist

ResourceExhaustedException - if the job master is too busy to run the job

cancel

public void cancel(long jobId)
            throws JobDoesNotExistException

Cancels a job.

Parameters:

jobId - the id of the job

Throws:

JobDoesNotExistException - when the job does not exist

list

public List<Long> list()

Returns:

list all the job ids

getStatus

public JobInfo getStatus(long jobId)
                  throws JobDoesNotExistException

Gets information of the given job id.

Parameters:

jobId - the id of the job

Returns:

the job information

Throws:

JobDoesNotExistException - if the job does not exist

getSummary

public JobServiceSummary getSummary()

Gets summary of the job service.

Returns:

JobServiceSummary

registerWorker

public long registerWorker(WorkerNetAddress workerNetAddress)

Returns a worker id for the given worker.

Parameters:

workerNetAddress - the worker WorkerNetAddress

Returns:

the worker id for this worker

getWorkerInfoList

public List<WorkerInfo> getWorkerInfoList()

Returns:

a list of WorkerInfo objects representing the workers in Alluxio

workerHeartbeat

public List<JobCommand> workerHeartbeat(long workerId,
                                        List<TaskInfo> taskInfoList)

Updates the tasks' status when a worker periodically heartbeats with the master, and sends the commands for the worker to execute.

Parameters:

workerId - the worker id

taskInfoList - the list of the task information

Returns:

the list of JobCommand to the worker