Integrating Under Storage Systems

Slack Docker Pulls GitHub edit source

Alluxio exposes an UnderFileSystem interface to enable any under storage to integrate with Alluxio. The current available under storage integrations can be found as submodules of the underfs module. To create a new module, the following components should be implemented:

  • An implementation of the UnderFileSystem interface, allowing Alluxio to communicate with the under storage.

  • A corresponding implementation of the UnderFileSystemFactory interface which allows Alluxio to match path URIs to the UnderFileSystem implementation.

  • A META-INF/services file to register the new integration

The HDFS Submodule and S3 Submodule are two good examples of how to enable a storage system to serve as Alluxio’s underlying storage.