Configuring Alluxio with HDP HDFS

Slack Docker Pulls

This guide describes how to configure Alluxio with Hortonworks Data Platform (HDP) HDFS as the under storage system.

Prerequisites

You should already have Hortonworks Data Platform HDFS installed.

Mounting HDP HDFS

HDP HDFS can be mounted to Alluxio at the root of the Alluxio namespace, or at a nested directory.

Root Mount

When installing Alluxio, the configuration settings must be specified in conf/alluxio-site.properties.

alluxio.underfs.address=hdfs://<NAMENODE_HOSTNAME>:8020/alluxio/data
alluxio.master.mount.table.root.option.alluxio.underfs.hdfs.version=hdp2.4

Nested Mount

Alluxio’s Command Line Interface can be used to mount HDP HDFS to a nested directory in the Alluxio namespace.

$ ./bin/alluxio fs mount --option alluxio.underfs.hdfs.version=hdp2.4 /mnt/hdp_hdfs hdfs://<NAMENODE_HOSTNAME>:8020/alluxio/data

Run Sample Tests

The simple tests can be run using the Alluxio Command Line Interface.

$ ./bin/alluxio runTests