alluxio.hadoop

Class HadoopUtils

java.lang.Object

alluxio.hadoop.HadoopUtils

@ThreadSafe
public final class HadoopUtils
extends Object

Utility class for using Alluxio with Hadoop.

Method Summary

Modifier and Type	Method and Description
static String	getAlluxioFileName(String path) Given a String path, returns an equivalent Alluxio path.
static String	getPathWithoutScheme(org.apache.hadoop.fs.Path path) Given a Path path, it returns the path component of its URI, which has the form scheme://authority/path.
static AlluxioConfiguration	toAlluxioConf(org.apache.hadoop.conf.Configuration conf)
static org.apache.hadoop.fs.Path	toPath(AlluxioURI alluxioURI)
static String	toStringHadoopFileSplit(org.apache.hadoop.mapred.FileSplit fs) Returns a string representation of a Hadoop FileSplit.
static String	toStringHadoopFileStatus(org.apache.hadoop.fs.FileStatus fs) Returns a string representation of a Hadoop FileStatus.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getPathWithoutScheme

public static String getPathWithoutScheme(org.apache.hadoop.fs.Path path)

Given a Path path, it returns the path component of its URI, which has the form scheme://authority/path.

Parameters:

path - an HDFS Path

Returns:

the path component of the Path URI

getAlluxioFileName

public static String getAlluxioFileName(String path)

Given a String path, returns an equivalent Alluxio path.

Parameters:

path - the path to parse

Returns:

a valid Alluxio path

toStringHadoopFileSplit

public static String toStringHadoopFileSplit(org.apache.hadoop.mapred.FileSplit fs)

Returns a string representation of a Hadoop FileSplit.

Parameters:

fs - Hadoop FileSplit

Returns:

its string representation

toStringHadoopFileStatus

public static String toStringHadoopFileStatus(org.apache.hadoop.fs.FileStatus fs)

Returns a string representation of a Hadoop FileStatus.

Parameters:

fs - Hadoop FileStatus

Returns:

its string representation

toPath

public static org.apache.hadoop.fs.Path toPath(AlluxioURI alluxioURI)

Parameters:

alluxioURI - Alluxio uri

Returns:

corresponding Hadoop Path instance

toAlluxioConf

public static AlluxioConfiguration toAlluxioConf(org.apache.hadoop.conf.Configuration conf)

Parameters:

conf - Hadoop conf

Returns:

Alluxio configuration merged from Hadoop conf