Alluxio Membership Management

Slack Docker Pulls GitHub edit source

Membership module is introduced to manage worker members registration/discovery. It offers the following way of managing worker members.

1) STATIC - Uses a static config file, default is $ALLUXIO_HOME/conf/workers, to configure a list of hostnames to form the Alluxio cluster. It doesn’t provide any capabilities to track new members joining, leaving, or the liveness state. Its purpose is to be used as a simple quickstart deployment way to spin up an Alluxio cluster. 2) ETCD - Uses a pre-configured standalone etcd cluster to manage worker membership. On startup, worker will register itself to etcd and then maintains its liveness onwards.

These are the capability two of these modules can do: | | STATIC | ETCD | | —————————-| ——- | —— | | Get full worker list | YES | YES | | Get live/failed worker list | NO | YES |



Use a static file, following the format of conf/workers. Append the hostname of each node as a new line in conf/workers. Comment out localhost if necessary. For example,

# An Alluxio Worker will be started on each of the machines listed below. 
# localhost

And configure with:


or just


then conf/workers will be used.


Depending on the deployment environment, Bare Metal or K8s, users could setup etcd cluster and Alluxio cluster individually, or through helm install with Alluxio’s k8s operator for a one-click install for both.

1) Bare Metal

Set up etcd cluster, refer to etcd doc here: Install a v3 etcd version as we do not support v2.

e.g. Say we have an etcd 3 node setup:

Name Address Hostname



[NOTICE] As etcd membership module relies on etcd’s high availability to provide membership service, include ALL the etcd cluster nodes in configuration (or at least all initial ones if new nodes have been bootstrapped into etcd later) to allow etcd membership module to redirect connection to etcd leader automatically.

After starting the Alluxio workers, use bin/alluxio info nodes to check status of worker registration.

WorkerId	Address	Status
6e715648b6f308cd8c90df531c76a028	ONLINE

2) K8s

For k8s deployment with Alluxio k8s operator, refer to [Install Alluxio on Kubernetes]../kubernetes/ we can start an Alluxio cluster along with etcd cluster pod(s) with [helm]../kubernetes/

To pull etcd dependency for helm repo, do

$ helm dependency update 

To configure Alluxio with a single pod etcd cluster, enable etcd component in k8s-operator/deploy/charts/alluxio/config.yaml

image: <docker_username>/<image-name>
imageTag: <tag>
  path: <ufs path>
  credentials: # s3 as example. Leave it empty if not needed. 
    aws.accessKeyId: xxxxxxxxxx
    aws.secretKey: xxxxxxxxxxxxxxx
    enabled: true

then under k8s-operator/deploy/charts/alluxio/ do:

$ helm install <cluster name> -f config.yaml .

then with kubectl get pods you can see etcd pod:

NAME                                    READY   STATUS     RESTARTS   AGE
<cluster name>-etcd-0                   0/1     Running    0          3s

Other values to configure for etcd, setting replicaCount to 3 will start a 3-member etcd cluster

  enabled: true
  replicaCount: 3

More info on the parameters, refer to

For detailed introduction on how the Registration/ServiceDiscovery is done with Etcd, check this doc: