alluxio.table.under.glue

Class GlueUtils

java.lang.Object

alluxio.table.under.glue.GlueUtils

public class GlueUtils
extends Object

Glue utils.

Method Summary

Modifier and Type	Method and Description
static String	makePartitionName(List<com.amazonaws.services.glue.model.Column> columns, List<String> partitionValues) Align to hive makePartName, convert glue partition information to alluxio partition name.
static String	makePartName(List<String> partCols, List<String> vals) Make partition name for glue, wrapper of hive makePartName.
static ColumnStatisticsInfo	toProto(com.amazonaws.services.glue.model.ColumnStatistics glueColumnStatistic) Convert glue ColumnStatistics to Alluxio ColumnStatisticsInfo.
static List<FieldSchema>	toProto(List<com.amazonaws.services.glue.model.Column> glueCloumns) Convert the Glue FieldSchema to Alluxio FieldSchema.
static Storage	toProto(com.amazonaws.services.glue.model.StorageDescriptor sd, PathTranslator translator) Convert the Glue Storage Descriptor and Translator information to Storage.
static Schema	toProtoSchema(List<com.amazonaws.services.glue.model.Column> glueColumns) Convert glue field schema to alluxio proto (Glue do not have filedschema api).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

toProtoSchema

public static Schema toProtoSchema(List<com.amazonaws.services.glue.model.Column> glueColumns)

Convert glue field schema to alluxio proto (Glue do not have filedschema api).

Parameters:

glueColumns - list of glue columns

Returns:

alluxio proto of schema

toProto

public static List<FieldSchema> toProto(List<com.amazonaws.services.glue.model.Column> glueCloumns)

Convert the Glue FieldSchema to Alluxio FieldSchema.

Parameters:

glueCloumns - Glue FiledSchema

Returns:

list of Alluxio FieldSchema

toProto

public static ColumnStatisticsInfo toProto(com.amazonaws.services.glue.model.ColumnStatistics glueColumnStatistic)

Convert glue ColumnStatistics to Alluxio ColumnStatisticsInfo.

Parameters:

glueColumnStatistic - glue column statistic info

Returns:

Alluxio ColumnStatisticsInfo

toProto

public static Storage toProto(com.amazonaws.services.glue.model.StorageDescriptor sd,
                              PathTranslator translator)
                       throws IOException

Convert the Glue Storage Descriptor and Translator information to Storage.

Parameters:

sd - the glue storage descriptor

translator - the glue translator

Returns:

storage proto

Throws:

IOException

makePartitionName

public static String makePartitionName(List<com.amazonaws.services.glue.model.Column> columns,
                                       List<String> partitionValues)
                                throws IOException

Align to hive makePartName, convert glue partition information to alluxio partition name.

Parameters:

columns - glue table partition keys

partitionValues - glue partition values

Returns:

partition name

Throws:

IOException

makePartName

public static String makePartName(List<String> partCols,
                                  List<String> vals)

Make partition name for glue, wrapper of hive makePartName.

Parameters:

partCols - partition columns

vals - partition values

Returns:

partition name