Configuring Alluxio with CDH HDFS

Slack Docker Pulls

This guide describes how to configure Alluxio with Cloudera Distribution (CDH) HDFS as the under storage system.

Prerequisites

You should already have Cloudera’s Distribution HDFS installed.

Mounting CDH HDFS

CDH HDFS can be mounted to Alluxio at the root of the Alluxio namespace, or at a nested directory.

Root Mount

When installing Alluxio, the configuration settings must be specified in conf/alluxio-site.properties.

alluxio.underfs.address=hdfs://<NAMENODE_HOSTNAME>:8020/alluxio/data
alluxio.master.mount.table.root.option.alluxio.underfs.hdfs.version=cdh5.8

Nested Mount

Alluxio’s Command Line Interface can be used to mount CDH HDFS to a nested directory in the Alluxio namespace.

$ ./bin/alluxio fs mount --option alluxio.underfs.hdfs.version=cdh5.8 /mnt/cdh_hdfs hdfs://<NAMENODE_HOSTNAME>:8020/alluxio/data

Run Sample Tests

The simple tests can be run using the Alluxio Command Line Interface.

$ ./bin/alluxio runTests