alluxio.hub.agent.util.file

Class PrestoCatalogUtils

java.lang.Object

alluxio.hub.agent.util.file.PrestoCatalogUtils

public class PrestoCatalogUtils
extends Object

Utilities for interacting with Presto via the hub agents.

Constructor Summary

Constructors

Constructor and Description
PrestoCatalogUtils()

Method Summary

Modifier and Type	Method and Description
static String	findGroup(String userName) Find the group name of a user.
static String	findUser(String programName) Find the user name of a running process.
static String	findUserForId(String id) Find the user name for given id.
static Pair<String,String>	getAlluxioUser() Get Alluxio process user and group.
static List<Path>	getCatalogAlluxioXmlConfigPath(Path catalogFile) Gets the set of files pointed at by hive.config.resources in the file, and returns an array of those files.
static Pair<String,String>	getPrestoUser() Get Presto process user and group.
static String	getPrimaryGroup(String userName) Find the primary group name of a user.
static Pair<String,String>	getProcessInfo(UploadProcessType type) Get user info based on process type.
static String	propertiesToXml(Properties props) Convert a set of Properties to a string of XML suitable for consumption by a process in the hadoop ecosystem.
static void	restartPrestoDataproc() Restarts presto in google dataproc environment.
static void	restartPrestoEmr() Restarts presto in AWS EMR environment.
static void	validateAssetName(String assetName, String assetType, Collection<CharSequence> invalidSet) Validate a particular string representing an asset (catalog, file, etc) does not contain any of a set of invalid character sequences.
static void	validateCatalogName(String catalogName) Validates that a catalog name does not contain any invalid characters.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PrestoCatalogUtils

public PrestoCatalogUtils()

Method Detail

getPrestoUser

public static Pair<String,String> getPrestoUser()

Get Presto process user and group.

Returns:

a pair indicating presto process user and group

getProcessInfo

public static Pair<String,String> getProcessInfo(UploadProcessType type)

Get user info based on process type.

Parameters:

type - Upload process type

Returns:

user information and group info

getAlluxioUser

public static Pair<String,String> getAlluxioUser()

Get Alluxio process user and group.

Returns:

a pair indicating alluxio process user and group

findUserForId

public static String findUserForId(String id)

Find the user name for given id.

Parameters:

id - user id

Returns:

user name

findUser

public static String findUser(String programName)

Find the user name of a running process.

Parameters:

programName - process name

Returns:

user name

findGroup

public static String findGroup(String userName)

Find the group name of a user.

Parameters:

userName - user name

Returns:

group name

getPrimaryGroup

public static String getPrimaryGroup(String userName)

Find the primary group name of a user.

Parameters:

userName - user name

Returns:

group name

propertiesToXml

public static String propertiesToXml(Properties props)

Convert a set of Properties to a string of XML suitable for consumption by a process in the hadoop ecosystem.

Parameters:

props - to convert, the original object remains unmodified

Returns:

a string representing the XML format of the properties provided

restartPrestoEmr

public static void restartPrestoEmr()
                             throws IOException

Restarts presto in AWS EMR environment. Based on the scripts in the integration/emr/ directory

Throws:

IOException - if the restart process fails

restartPrestoDataproc

public static void restartPrestoDataproc()
                                  throws IOException

Restarts presto in google dataproc environment.

Throws:

IOException - if the restart command does not exit successfully

getCatalogAlluxioXmlConfigPath

public static List<Path> getCatalogAlluxioXmlConfigPath(Path catalogFile)
                                                 throws IOException

Gets the set of files pointed at by hive.config.resources in the file, and returns an array of those files.

Parameters:

catalogFile - the path to the catalog file

Returns:

an array representing the files pointed to by the property hive.config.resources

Throws:

IOException

validateCatalogName

public static void validateCatalogName(String catalogName)
                                throws AlluxioException

Validates that a catalog name does not contain any invalid characters.

Parameters:

catalogName - string representing the name of the catalog to validate

Throws:

AlluxioException - if the name is invalid

validateAssetName

public static void validateAssetName(String assetName,
                                     String assetType,
                                     Collection<CharSequence> invalidSet)
                              throws AlluxioException

Validate a particular string representing an asset (catalog, file, etc) does not contain any of a set of invalid character sequences.

Parameters:

assetName - the asset string being validated

assetType - the type of asset that is being validated. This is used in the error message when validation is not successful

invalidSet - the set of invalid character sequences which are disallowed in the assetName

Throws:

AlluxioException - when validation fails