alluxio.master

Class AbstractLocalAlluxioCluster

java.lang.Object

alluxio.master.AbstractLocalAlluxioCluster

Direct Known Subclasses:

LocalAlluxioCluster, MultiMasterLocalAlluxioCluster

@NotThreadSafe
public abstract class AbstractLocalAlluxioCluster
extends Object

Local Alluxio cluster.

Field Summary

Fields

Modifier and Type	Field and Description
protected String	mHostname
protected ProxyProcess	mProxyProcess
protected Thread	mProxyThread
protected String	mWorkDirectory
protected List<WorkerProcess>	mWorkers
protected List<Thread>	mWorkerThreads

Method Summary

Modifier and Type	Method and Description
void	formatAndRestartMasters() Stops the masters, formats them, and then restarts them.
abstract FileSystem	getClient() Returns a FileSystem client.
abstract FileSystem	getClient(FileSystemContext context)
protected abstract LocalAlluxioMaster	getLocalAlluxioMaster()
ProxyProcess	getProxyProcess() Gets the proxy process.
abstract void	initConfiguration(String name) Creates a default ServerConfiguration for testing.
boolean	isStartedWorkers()
protected void	reset() Resets the cluster to original state.
protected void	resetClientPools() Resets the client pools to the original state.
void	restartMasters() Restarts the master(s).
protected void	setAlluxioWorkDirectory(String name) Sets Alluxio work directory.
protected void	setHostname() Sets hostname.
protected void	setupTest() Sets up corresponding directories for tests.
void	start() Starts both master and a worker using the configurations in test conf respectively.
protected abstract void	startMasters() Configures and starts the master(s).
void	startWorkers() Configures and starts the worker(s).
void	stop() Stops both the alluxio and underfs service threads.
void	stopFS() Stops the alluxio filesystem's service thread only.
protected abstract void	stopMasters() Stops the masters.
protected void	stopProxy() Stops the proxy.
void	stopWorkers() Stops the workers.
void	waitForWorkersRegistered(int timeoutMs) Waits for all workers registered with master.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mProxyProcess

protected ProxyProcess mProxyProcess

mProxyThread

protected Thread mProxyThread

mWorkers

protected List<WorkerProcess> mWorkers

mWorkerThreads

protected List<Thread> mWorkerThreads

mWorkDirectory

protected String mWorkDirectory

mHostname

protected String mHostname

Method Detail

start

public void start()
           throws Exception

Starts both master and a worker using the configurations in test conf respectively.

Throws:

Exception

startMasters

protected abstract void startMasters()
                              throws Exception

Configures and starts the master(s).

Throws:

Exception

restartMasters

public void restartMasters()
                    throws Exception

Restarts the master(s).

Throws:

Exception

startWorkers

public void startWorkers()
                  throws Exception

Configures and starts the worker(s).

Throws:

Exception

setupTest

protected void setupTest()
                  throws IOException

Sets up corresponding directories for tests.

Throws:

IOException

stop

public void stop()
          throws Exception

Stops both the alluxio and underfs service threads.

Throws:

Exception

stopFS

public void stopFS()
            throws Exception

Stops the alluxio filesystem's service thread only.

Throws:

Exception

formatAndRestartMasters

public void formatAndRestartMasters()
                             throws Exception

Stops the masters, formats them, and then restarts them. This is useful if a fresh state is desired, for example when restoring from a backup.

Throws:

Exception

stopMasters

protected abstract void stopMasters()
                             throws Exception

Stops the masters.

Throws:

Exception

stopProxy

protected void stopProxy()
                  throws Exception

Stops the proxy.

Throws:

Exception

stopWorkers

public void stopWorkers()
                 throws Exception

Stops the workers.

Throws:

Exception

isStartedWorkers

public boolean isStartedWorkers()

Returns:

true if the workers are started, and not stopped

initConfiguration

public abstract void initConfiguration(String name)
                                throws IOException

Creates a default ServerConfiguration for testing.

Parameters:

name - the name of the test/cluster

Throws:

IOException

getClient

public abstract FileSystem getClient()
                              throws IOException

Returns a FileSystem client.

Returns:

a FileSystem client

Throws:

IOException

getClient

public abstract FileSystem getClient(FileSystemContext context)
                              throws IOException

Parameters:

context - the FileSystemContext to use

Returns:

a FileSystem client, using a specific context

Throws:

IOException

getLocalAlluxioMaster

protected abstract LocalAlluxioMaster getLocalAlluxioMaster()

Returns:

the local Alluxio master

getProxyProcess

public ProxyProcess getProxyProcess()

Gets the proxy process.

Returns:

the proxy

waitForWorkersRegistered

public void waitForWorkersRegistered(int timeoutMs)
                              throws TimeoutException,
                                     InterruptedException,
                                     IOException

Waits for all workers registered with master.

Parameters:

timeoutMs - the timeout to wait

Throws:

TimeoutException

InterruptedException

IOException

reset

protected void reset()

Resets the cluster to original state.

resetClientPools

protected void resetClientPools()
                         throws IOException

Resets the client pools to the original state.

Throws:

IOException

setHostname

protected void setHostname()

Sets hostname.

setAlluxioWorkDirectory

protected void setAlluxioWorkDirectory(String name)

Sets Alluxio work directory.

Parameters:

name - the name of the test/cluster