alluxio.cli.fs.command

Class AbstractDistributedJobCommand

java.lang.Object

alluxio.cli.fs.command.AbstractFileSystemCommand

alluxio.cli.fs.command.AbstractDistributedJobCommand

All Implemented Interfaces:

Command, Closeable, AutoCloseable

Direct Known Subclasses:

AbstractTableCommand, DistributedCpCommand, DistributedLoadCommand, DistributedMvCommand, GetCmdStatusCommand

public abstract class AbstractDistributedJobCommand
extends AbstractFileSystemCommand

The base class for all the distributed job based Command classes. It provides handling for submitting multiple jobs and handling retries of them.

Field Summary

Fields

Modifier and Type	Field and Description
protected static int	DEFAULT_ACTIVE_JOBS
protected int	mActiveJobs
protected JobMasterClient	mClient
protected List<JobAttempt>	mSubmittedJobAttempts
protected static org.apache.commons.cli.Option	WAIT_OPTION

Fields inherited from class alluxio.cli.fs.command.AbstractFileSystemCommand

mFileSystem, mFsContext

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractDistributedJobCommand(FileSystemContext fsContext)

Method Summary

Modifier and Type	Method and Description
protected void	drain()
int	getCompletedCmdCount() Gets the number of completed commands.
int	getCompletedCount() Gets the number of completed jobs.
int	getFailedCmdCount() Gets the number of failed commands.
Set<String>	getFailedFiles() Gets failed files.
protected Long	submit(CmdConfig cmdConfig)
protected void	waitForCmd(long jobControlId) Waits for command to complete.
protected void	waitJob() Waits for at least one job to complete.

Methods inherited from class alluxio.cli.fs.command.AbstractFileSystemCommand

processHeader, runPlainPath, runWildCardCmd

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.cli.Command

close, getCommandName, getDescription, getOptions, getSubCommands, getUsage, hasSubCommand, parseAndValidateArgs, run, validateArgs

Field Detail

DEFAULT_ACTIVE_JOBS

protected static final int DEFAULT_ACTIVE_JOBS

See Also:

Constant Field Values

WAIT_OPTION

protected static final org.apache.commons.cli.Option WAIT_OPTION

mSubmittedJobAttempts

protected List<JobAttempt> mSubmittedJobAttempts

mActiveJobs

protected int mActiveJobs

mClient

protected final JobMasterClient mClient

Constructor Detail

AbstractDistributedJobCommand

protected AbstractDistributedJobCommand(FileSystemContext fsContext)

Method Detail

drain

protected void drain()

submit

protected Long submit(CmdConfig cmdConfig)

waitJob

protected void waitJob()

Waits for at least one job to complete.

waitForCmd

protected void waitForCmd(long jobControlId)

Waits for command to complete.

getCompletedCount

public int getCompletedCount()

Gets the number of completed jobs.

Returns:

the number of completed job

getFailedCmdCount

public int getFailedCmdCount()

Gets the number of failed commands.

Returns:

number of failed commands

getCompletedCmdCount

public int getCompletedCmdCount()

Gets the number of completed commands.

Returns:

the number of completed commands

getFailedFiles

public Set<String> getFailedFiles()

Gets failed files.

Returns:

failed files