alluxio.master.table

Class DefaultTableMaster

java.lang.Object

alluxio.master.AbstractMaster

alluxio.master.CoreMaster

alluxio.master.table.DefaultTableMaster

All Implemented Interfaces:

Checkpointed, DelegatingJournaled, Journaled, JournalEntryIterable, Master, TableMaster, Server<Boolean>

public class DefaultTableMaster
extends CoreMaster
implements TableMaster, DelegatingJournaled

This table master manages catalogs metadata information.

Field Summary

Fields

Modifier and Type	Field and Description
static String	DEFAULT_TRANSFORMATION

Fields inherited from class alluxio.master.CoreMaster

mBackupManager, mJournalSystem, mPort, mSafeModeManager, mStartTimeMs

Fields inherited from class alluxio.master.AbstractMaster

mClock, mMasterContext

Constructor Summary

Constructors

Constructor and Description
DefaultTableMaster(CoreMasterContext context, JobMasterClient jobMasterClient) Constructor for DefaultTableMaster.

Method Summary

Modifier and Type	Method and Description
SyncStatus	attachDatabase(String udbType, String udbConnectionUri, String udbDbName, String dbName, Map<String,String> configuration, boolean ignoreSyncErrors) Attach an existing database to the catalog.
void	close() Closes the server.
boolean	detachDatabase(String dbName) Remove an existing database in the catalog.
List<String>	getAllDatabases() Get a listing of all databases.
List<String>	getAllTables(String databaseName) Get a listing of all tables in a database.
List<TransformJobInfo>	getAllTransformJobInfo()
Database	getDatabase(String dbName) Gets a database object.
Journaled	getDelegate()
Set<Class<? extends Server>>	getDependencies()
String	getName()
Map<String,ColumnStatisticsList>	getPartitionColumnStatistics(String dbName, String tableName, List<String> partNamesList, List<String> colNamesList) Get statistics on the partitions.
Map<ServiceType,GrpcService>	getServices()
Table	getTable(String dbName, String tableName) Get a table.
List<ColumnStatisticsInfo>	getTableColumnStatistics(String dbName, String tableName, List<String> colNames) Get statistics on the table.
TransformJobInfo	getTransformJobInfo(long jobId)
List<Partition>	readTable(String dbName, String tableName, Constraint constraint) Returns metadata for reading a table given constraints.
void	start(Boolean isLeader) Starts the Alluxio server.
void	stop() Stops the Alluxio server.
SyncStatus	syncDatabase(String dbName) Syncs a database.
long	transformTable(String dbName, String tableName, String definition) Transforms a table to a new table.

Methods inherited from class alluxio.master.AbstractMaster

createJournalContext, getExecutorService, getMasterContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.master.Master

createJournalContext, getMasterContext

Methods inherited from interface alluxio.master.journal.Journaled

applyAndJournal, processJournalEntry, resetState, restoreFromCheckpoint, writeToCheckpoint

Methods inherited from interface alluxio.master.journal.checkpoint.Checkpointed

getCheckpointName

Methods inherited from interface alluxio.master.journal.JournalEntryIterable

getJournalEntryIterator

Methods inherited from interface alluxio.master.journal.DelegatingJournaled

applyAndJournal, getCheckpointName, getJournalEntryIterator, processJournalEntry, resetState, restoreFromCheckpoint, writeToCheckpoint

Field Detail

DEFAULT_TRANSFORMATION

public static final String DEFAULT_TRANSFORMATION

See Also:

Constant Field Values

Constructor Detail

DefaultTableMaster

public DefaultTableMaster(CoreMasterContext context,
                          JobMasterClient jobMasterClient)

Constructor for DefaultTableMaster.

Parameters:

context - core master context

jobMasterClient - the job master client for transformation

Method Detail

attachDatabase

public SyncStatus attachDatabase(String udbType,
                                 String udbConnectionUri,
                                 String udbDbName,
                                 String dbName,
                                 Map<String,String> configuration,
                                 boolean ignoreSyncErrors)
                          throws IOException

Description copied from interface: TableMaster

Attach an existing database to the catalog.

Specified by:

attachDatabase in interface TableMaster

Parameters:

udbType - the database type

udbConnectionUri - the udb connection uri

udbDbName - the database name in the udb

dbName - the database name in Alluxio

configuration - the configuration

ignoreSyncErrors - if true, will ignore sync errors during the attach

Returns:

the sync status for the attach

Throws:

IOException

detachDatabase

public boolean detachDatabase(String dbName)
                       throws IOException

Description copied from interface: TableMaster

Remove an existing database in the catalog.

Specified by:

detachDatabase in interface TableMaster

Parameters:

dbName - the database name to remove

Returns:

true if deletion is successful

Throws:

IOException

getAllDatabases

public List<String> getAllDatabases()
                             throws IOException

Description copied from interface: TableMaster

Get a listing of all databases.

Specified by:

getAllDatabases in interface TableMaster

Returns:

a list of database

Throws:

IOException

getAllTables

public List<String> getAllTables(String databaseName)
                          throws IOException

Description copied from interface: TableMaster

Get a listing of all tables in a database.

Specified by:

getAllTables in interface TableMaster

Parameters:

databaseName - database name

Returns:

a list of tables

Throws:

IOException

getTable

public Table getTable(String dbName,
                      String tableName)
               throws IOException

Description copied from interface: TableMaster

Get a table.

Specified by:

getTable in interface TableMaster

Parameters:

dbName - database name

tableName - table name

Returns:

a Table object

Throws:

IOException

getTableColumnStatistics

public List<ColumnStatisticsInfo> getTableColumnStatistics(String dbName,
                                                           String tableName,
                                                           List<String> colNames)
                                                    throws IOException

Description copied from interface: TableMaster

Get statistics on the table.

Specified by:

getTableColumnStatistics in interface TableMaster

Parameters:

dbName - database name

tableName - table name

colNames - column names

Returns:

a list of column statistics info

Throws:

IOException

readTable

public List<Partition> readTable(String dbName,
                                 String tableName,
                                 Constraint constraint)
                          throws IOException

Description copied from interface: TableMaster

Returns metadata for reading a table given constraints.

Specified by:

readTable in interface TableMaster

Parameters:

dbName - database name

tableName - table name

constraint - constraint

Returns:

a list of partition information

Throws:

IOException

getPartitionColumnStatistics

public Map<String,ColumnStatisticsList> getPartitionColumnStatistics(String dbName,
                                                                     String tableName,
                                                                     List<String> partNamesList,
                                                                     List<String> colNamesList)
                                                              throws IOException

Description copied from interface: TableMaster

Get statistics on the partitions.

Specified by:

getPartitionColumnStatistics in interface TableMaster

Parameters:

dbName - database name

tableName - table name

partNamesList - partition names

colNamesList - column names

Returns:

a map mapping partition names to a list of column statistics info

Throws:

IOException

transformTable

public long transformTable(String dbName,
                           String tableName,
                           String definition)
                    throws IOException

Description copied from interface: TableMaster

Transforms a table to a new table.

Specified by:

transformTable in interface TableMaster

Parameters:

dbName - the database name

tableName - the table name

definition - the transformation definition

Returns:

the job ID

Throws:

IOException

getTransformJobInfo

public TransformJobInfo getTransformJobInfo(long jobId)
                                     throws IOException

Specified by:

getTransformJobInfo in interface TableMaster

Parameters:

jobId - the job ID

Returns:

the information for the transformation job

Throws:

IOException

getAllTransformJobInfo

public List<TransformJobInfo> getAllTransformJobInfo()
                                              throws IOException

Specified by:

getAllTransformJobInfo in interface TableMaster

Returns:

a list of information for all the transformation jobs

Throws:

IOException

syncDatabase

public SyncStatus syncDatabase(String dbName)
                        throws IOException

Description copied from interface: TableMaster

Syncs a database.

Specified by:

syncDatabase in interface TableMaster

Parameters:

dbName - the database name

Returns:

the resulting sync status

Throws:

IOException

getDatabase

public Database getDatabase(String dbName)
                     throws IOException

Description copied from interface: TableMaster

Gets a database object.

Specified by:

getDatabase in interface TableMaster

Parameters:

dbName - the database name

Returns:

a database object

Throws:

IOException

getDependencies

public Set<Class<? extends Server>> getDependencies()

Specified by:

getDependencies in interface Server<Boolean>

Overrides:

getDependencies in class AbstractMaster

Returns:

the server dependencies

getName

public String getName()

Specified by:

getName in interface Server<Boolean>

Returns:

the server's name

getServices

public Map<ServiceType,GrpcService> getServices()

Specified by:

getServices in interface Server<Boolean>

Returns:

a map from service names to gRPC serviced that serve RPCs for this server

start

public void start(Boolean isLeader)
           throws IOException

Description copied from interface: Server

Starts the Alluxio server.

Specified by:

start in interface Server<Boolean>

Overrides:

start in class AbstractMaster

Parameters:

isLeader - the start options

Throws:

IOException

stop

public void stop()
          throws IOException

Description copied from interface: Server

Stops the Alluxio server. Here, anything created or started in #start(T) should be cleaned up and shutdown.

Specified by:

stop in interface Server<Boolean>

Overrides:

stop in class AbstractMaster

Throws:

IOException

close

public void close()
           throws IOException

Description copied from interface: Server

Closes the server.

Specified by:

close in interface Server<Boolean>

Overrides:

close in class AbstractMaster

Throws:

IOException

getDelegate

public Journaled getDelegate()

Specified by:

getDelegate in interface DelegatingJournaled

Returns:

the object to delegate to